-- Logs begin at Tue 2021-04-20 18:38:47 UTC, end at Tue 2021-04-20 19:38:09 UTC. -- Apr 20 19:08:56.314912 dv-cinder-786933-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 19:08:56.322731 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 19:08:56 2021] *** Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: nodename: dv-cinder-786933-2-iscsi Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: machine: x86_64 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: clock source: unix Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: pcre jit disabled Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: detected number of CPU cores: 4 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: current working directory: / Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: detected binary path: /usr/bin/uwsgi-core Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: dropping root privileges as early as possible Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: your processes number limit is 47843 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: your memory page size is 4096 bytes Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: detected max file descriptor number: 2048 Apr 20 19:08:56.324996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: lock engine: pthread robust mutexes Apr 20 19:08:56.326189 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: thunder lock: enabled Apr 20 19:08:56.326189 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 19:08:56.326189 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: dropping root privileges after socket binding Apr 20 19:08:56.326189 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 19:08:56.371445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: Python main interpreter initialized at 0x55ea3d4ac9c0 Apr 20 19:08:56.371445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: dropping root privileges after plugin initialization Apr 20 19:08:56.371445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: python threads support enabled Apr 20 19:08:56.371445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: your server socket listen backlog is limited to 100 connections Apr 20 19:08:56.371445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: your mercy for graceful operations on workers is 90 seconds Apr 20 19:08:56.371882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 19:08:56.371882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: *** Operational MODE: preforking *** Apr 20 19:08:56.372064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: dropping root privileges after application loading Apr 20 19:08:56.372064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: *** uWSGI is running in multiple interpreter mode *** Apr 20 19:08:56.372064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: spawned uWSGI master process (pid: 85668) Apr 20 19:08:56.372911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: spawned uWSGI worker 1 (pid: 85669, cores: 1) Apr 20 19:08:56.372911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: spawned uWSGI worker 2 (pid: 85670, cores: 1) Apr 20 19:08:56.372911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 19:08:56.372239 dv-cinder-786933-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 19:09:01.309698 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:09:01.310311 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:09:01.310794 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:09:01.311112 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:09:01.311590 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:09:01.312015 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:09:01.312306 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:09:01.312706 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:09:01.312857 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.313103 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.313257 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:09:01.313369 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:09:01.313471 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.313790 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.313964 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314196 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314339 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314525 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314630 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314883 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.314985 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315230 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315362 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315575 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315729 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315847 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.315952 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316188 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316296 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316555 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786933-2-iscsi {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316653 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316897 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.316987 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.317235 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.317360 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.317581 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.317684 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786933-2-iscsi {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.317966 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318067 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318309 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318418 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318656 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318763 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.318989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.319096 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.319344 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.319606 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.319715 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.319951 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.320049 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.320294 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.320632 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.320751 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.320990 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.321104 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.321329 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.321428 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.321674 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.321793 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322187 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322411 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322525 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322757 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.322855 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323092 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323190 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323453 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786933-2-iscsi {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323550 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323802 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.323911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.324151 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.324261 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.324528 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.324619 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786933-2-iscsi {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.324903 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.325005 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.325263 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.325365 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.325626 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.325744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326015 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326117 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326377 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326487 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326723 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.326829 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327097 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327196 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327463 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327561 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327810 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.327907 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328164 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328262 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328505 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328609 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328851 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.328950 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329196 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329299 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329534 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329638 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329888 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.329989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330233 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330333 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330518 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330624 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330862 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.330988 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331224 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331325 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331519 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331627 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331873 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.331976 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332167 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332277 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332453 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332595 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332813 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.332970 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333279 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333524 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333629 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333866 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.333979 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.334223 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.334331 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.334573 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.334671 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.334908 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335015 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335252 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335399 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335590 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335690 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.335926 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336029 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336271 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336375 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336617 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336721 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.336960 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.337059 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.337295 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.337401 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.337664 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.337769 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338069 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338170 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338424 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338530 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338758 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.338856 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339142 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339242 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339486 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339585 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339825 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.339939 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.340227 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.340333 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.340589 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.340704 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.340950 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.341130 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.341298 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.341415 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.341645 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.341746 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342034 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342153 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342386 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342495 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342721 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.342821 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343004 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343113 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343342 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343446 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343684 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.343782 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344016 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344115 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344359 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344466 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344700 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.344799 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345033 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345139 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345373 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345472 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345715 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.345813 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346101 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346211 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346444 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346542 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346784 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.346888 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.347118 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.347217 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.347459 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.347557 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348159 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348270 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348502 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348600 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348835 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.348938 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349284 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349529 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349634 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349887 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.349999 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.350225 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.350330 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.350566 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.350665 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.350905 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351004 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351246 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351351 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351579 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351678 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.351919 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352026 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352280 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352386 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352612 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352697 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.352954 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.353052 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.353303 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.353409 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.353643 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.353748 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354001 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354110 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354362 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354448 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354699 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.354804 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355036 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355134 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355387 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355494 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355778 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.355880 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356112 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356210 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356454 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356553 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356792 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.356890 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357130 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357229 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357462 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357561 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357798 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.357909 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358156 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358261 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358491 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358591 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358828 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.358932 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359176 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359281 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359511 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359609 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359855 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.359957 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360194 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360303 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360535 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360633 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360887 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.360984 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.361234 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.361342 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.361602 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:09:01.361700 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.361971 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.362084 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.362347 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.362458 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.362718 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.362802 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363070 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363167 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363410 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363509 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363759 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.363857 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364124 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364222 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364472 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364562 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364820 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.364919 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365155 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365253 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365521 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365625 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365884 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.365985 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.366249 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.366361 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.366596 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.366694 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.366949 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.367048 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.367304 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.367409 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.367650 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.367757 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368002 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368111 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368355 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368453 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368700 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.368798 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369060 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369166 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369435 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369552 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369802 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.369939 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370173 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370279 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370537 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370635 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370886 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.370993 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.371273 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.371382 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.371625 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.371730 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.371972 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.372077 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.372311 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.372411 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.372663 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.372762 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373012 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373109 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373350 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373449 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373702 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.373801 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374078 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374424 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374528 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374758 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.374856 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375104 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375204 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375451 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375550 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375790 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.375896 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376125 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376235 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376465 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376567 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376819 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.376925 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.377151 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.377257 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.377507 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.377606 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.377881 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378003 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378195 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378300 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378544 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378643 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378883 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.378990 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.379229 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.379329 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.379577 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.379676 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.379911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380011 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380259 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380358 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380595 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380694 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.380935 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.381035 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.381294 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.381403 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.381637 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.381736 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382002 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382115 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382351 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382456 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382693 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.382842 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383033 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383132 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383381 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383480 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383726 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.383825 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384068 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384168 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384413 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384516 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384778 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.384873 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.385126 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.385231 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.385474 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.385573 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.385910 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386024 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386234 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386333 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386580 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386682 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.386976 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.387092 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.387324 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.387430 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.387665 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.387765 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388004 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388114 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388335 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388435 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388682 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.388780 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389011 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389119 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389349 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389517 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389681 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.389780 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390050 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390160 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390390 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390489 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390740 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.390839 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391074 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391174 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391412 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391511 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.391851 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392082 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392185 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392428 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392527 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392778 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.392906 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393127 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393227 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393462 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393560 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393820 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.393960 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394198 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394298 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394543 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394642 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394883 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.394989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.395224 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.395330 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.395570 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.395669 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.395922 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396089 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396254 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396358 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396598 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396712 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.396937 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397043 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397281 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397380 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397629 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397728 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.397990 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.398103 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.398353 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.398452 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.398689 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.398794 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399049 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399155 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399400 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399499 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399737 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.399836 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400096 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400197 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400455 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400554 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400786 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.400886 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401134 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401233 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401477 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401576 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401815 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.401996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.402188 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.402288 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.402576 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.402688 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.402930 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403036 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403267 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403366 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403609 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403708 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.403949 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404055 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404294 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404393 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404644 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.404984 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.405075 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.405336 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.405436 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.405695 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.405795 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406058 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406401 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406500 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406760 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.406860 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407097 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407207 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407437 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407536 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407778 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.407883 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408118 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408223 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408463 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408563 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408814 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.408913 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409143 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409242 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409495 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409593 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409879 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.409981 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.410221 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.410329 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.410596 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.410744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.410922 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411021 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411265 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411364 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411613 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411712 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.411963 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412063 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412300 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412400 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412650 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412749 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.412997 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.413147 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.413338 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.413445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.413676 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.413777 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414067 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414414 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414540 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414762 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.414861 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415099 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415206 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415446 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415544 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415790 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.415895 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.416133 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.416239 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.416473 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.416821 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.416919 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.417173 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.417279 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.417518 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.417906 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.418019 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.418295 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.418402 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.418650 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.418747 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419011 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419105 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419372 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419473 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419721 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.419821 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420061 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420155 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420409 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420502 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420751 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.420844 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421089 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421182 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421435 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421536 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421769 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.421880 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422139 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422233 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422480 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422584 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422820 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.422921 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423153 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423265 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423491 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423601 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423823 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.423925 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424163 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424269 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424507 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424615 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424843 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.424949 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425179 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425328 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425525 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425633 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425891 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.425991 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.426241 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.426336 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.426577 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.426671 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.426921 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427012 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427259 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427353 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427596 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427691 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.427944 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.428045 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.428299 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.428398 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.428640 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.428730 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429011 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429105 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429346 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429439 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429689 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.429789 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430083 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430178 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430425 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430532 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430766 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.430860 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431112 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431205 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431450 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431554 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431799 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.431900 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432153 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432247 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432495 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432596 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432832 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.432925 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.433170 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.433264 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.433583 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.433746 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.433952 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434055 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434259 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434352 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434590 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434705 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.434928 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435033 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435263 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435408 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435614 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435715 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.435948 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436048 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436285 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436385 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436637 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436738 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.436979 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.437079 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.437312 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.437412 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.437657 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.437763 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438025 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438126 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438361 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438470 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438708 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.438808 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439058 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439156 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439397 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439497 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439725 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.439825 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440070 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440169 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440409 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440518 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440747 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.440846 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441075 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441173 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441417 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441523 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441746 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.441866 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442111 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442211 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442450 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442555 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442784 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.442882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443114 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443218 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443455 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443561 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443789 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.443887 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444127 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444233 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444457 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444564 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444796 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.444905 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445138 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445236 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445488 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445588 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445864 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.445966 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.446238 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.446347 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.446580 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.446680 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.446928 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.447033 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.447277 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.447382 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.447616 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.447717 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448028 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448138 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448317 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448420 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448662 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448762 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.448993 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.449100 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.449359 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.449463 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.449710 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.449811 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450081 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450180 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450421 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450534 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450772 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.450877 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451118 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451216 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451471 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451581 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451812 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.451911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452158 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452258 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452504 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452613 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452842 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.452947 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453180 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453278 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453523 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453634 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453869 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.453982 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.454225 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.454324 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.454571 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.454671 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.454909 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455008 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455256 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455355 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455593 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455693 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.455937 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456036 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456273 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456372 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456612 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456717 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.456955 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457055 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457291 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457390 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457629 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457728 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.457989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.458091 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.458331 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.458444 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.458673 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.458778 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459004 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459109 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459345 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459450 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459701 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.459800 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460046 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460145 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460426 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460591 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460774 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.460874 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461121 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461220 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461473 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461579 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461816 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.461965 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.462185 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.462290 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.462536 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.462712 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.462895 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.463064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.463244 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.463412 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.463726 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.463826 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464069 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464171 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464408 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464508 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464748 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.464853 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465148 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465234 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465488 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465593 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465853 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.465966 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466193 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466292 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466540 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466640 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466874 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.466974 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.467208 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.467337 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.467582 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.467688 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.467932 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.468034 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.468304 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.468402 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.468760 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.468868 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469108 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469213 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469448 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469558 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469802 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.469941 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470191 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470287 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470554 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470649 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470895 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.470997 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.471245 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.471339 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.471590 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.471691 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.471937 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.472043 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.472291 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.472391 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.472635 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.473092 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.473339 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.473433 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.473677 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.473770 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474060 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474184 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474415 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474517 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474753 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.474853 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475107 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475213 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475469 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475572 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475828 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.475927 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.476197 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.476303 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.476551 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.476656 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.476921 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477041 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477264 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477371 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477605 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477705 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.477979 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.478091 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.478320 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.478432 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.478661 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.478760 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479018 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479126 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479349 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479456 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479688 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.479787 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480025 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480125 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480371 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480478 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480732 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.480830 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481071 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481171 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481417 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481524 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481743 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.481869 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482115 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482224 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482456 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482556 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482802 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.482900 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483151 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483249 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483491 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483591 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483854 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.483954 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484189 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484287 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484530 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484630 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484869 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.484974 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.485211 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.485310 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.485554 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.485656 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.485929 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486032 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486280 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486389 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486642 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486752 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.486995 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.487093 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.487334 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.487444 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.487711 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.487816 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488074 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488173 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488419 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488525 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488767 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.488865 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489133 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489240 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489472 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489579 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489812 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.489952 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490194 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490292 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490534 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490635 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490872 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.490979 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491203 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491302 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491544 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491643 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491873 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.491972 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492212 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492316 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492549 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492647 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492885 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.492984 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.493218 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.493322 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.493552 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.493651 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.493966 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494070 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494308 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494408 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494651 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494764 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.494990 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.495089 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.495326 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.495424 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.495677 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.495786 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496024 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496124 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496430 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496541 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496795 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.496896 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.497164 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.497263 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.497512 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.497611 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.497898 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498002 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498256 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498359 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498609 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498709 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.498954 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499060 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499307 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499407 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499655 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499766 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.499998 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.500143 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.500348 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.500449 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.500684 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.500790 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501036 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501135 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501377 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501478 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501718 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.501825 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.502104 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.502331 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.502431 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.502700 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.502800 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.503051 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.503361 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.503463 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.503716 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.503824 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504073 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504173 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504420 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504520 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504767 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.504866 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505121 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505222 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505465 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505564 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505804 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.505939 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.506183 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.506284 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.506541 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.506640 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.506900 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507006 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507270 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507377 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507622 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507722 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.507975 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.508081 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.508324 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.508447 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.508680 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.508785 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509035 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509142 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509398 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509504 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509734 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.509851 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510119 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510225 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510476 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510576 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510833 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.510934 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.511186 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.511286 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.511537 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.511636 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.511912 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512022 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512268 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512367 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512611 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512719 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.512958 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.513167 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.513307 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.513413 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.513655 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.513755 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514054 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514167 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514415 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514515 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514767 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.514868 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515122 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515244 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515473 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515574 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515824 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.515931 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.516174 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.516405 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.516508 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.516762 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.516863 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.517136 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.517432 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.517538 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.517793 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.517956 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.518196 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.518303 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.518555 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.518655 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.518919 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519027 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519255 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519361 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519600 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519700 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.519952 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520051 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520294 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520402 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520625 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520725 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.520972 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.521072 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.521315 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.521422 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.521653 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.521752 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.522054 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.522156 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.522398 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.522508 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.522739 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.523009 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.523108 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.523415 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.523520 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.523771 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524026 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524126 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524436 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524535 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524796 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.524896 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.525170 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.525270 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.525545 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.525650 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.525920 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526026 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526265 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526392 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526612 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526713 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.526962 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.527062 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.527297 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.527397 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.527760 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.527862 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528113 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528219 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528457 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528563 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528791 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.528898 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529137 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529236 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529482 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529582 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529824 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.529964 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530194 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530293 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530536 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530643 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.530989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.531225 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.531331 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.531560 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.531665 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.531899 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532009 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532232 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532338 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532574 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532673 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.532910 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533017 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533242 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533347 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533583 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533682 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.533939 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534045 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534292 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534392 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534633 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534734 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.534972 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535078 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535313 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535412 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535654 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535754 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.535989 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.536097 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.536328 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.536428 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.536672 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.536772 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537018 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537119 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537355 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537455 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537702 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.537801 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538076 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538178 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538447 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538558 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538793 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.538900 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.539138 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.539389 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.539537 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.539764 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.539905 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.540121 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.540505 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.540605 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.540883 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.540998 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.541217 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.541325 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.541562 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.541661 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.541929 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.542034 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.542295 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.542406 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.542644 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.542744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543011 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543117 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543362 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543463 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543709 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.543808 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544055 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544155 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544393 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544494 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544738 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.544838 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545075 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545175 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545421 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545522 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545759 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.545893 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546131 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546302 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546486 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546615 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546831 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.546936 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.547185 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.547292 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.547541 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.547654 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.547886 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548000 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548238 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548346 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548587 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548687 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.548925 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549030 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549272 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549383 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549627 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549727 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.549996 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.550099 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.550340 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.550442 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.550715 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.550815 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551081 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551181 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551431 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551533 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551787 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.551893 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552136 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552241 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552507 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552608 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552887 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.552987 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.553238 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.553338 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.553613 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.553713 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.553983 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.554086 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.554324 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.554438 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.554664 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.554765 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555012 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555111 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555391 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555497 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555741 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.555842 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556086 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556177 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556478 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556585 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556853 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.556959 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.557204 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.557304 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.557541 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.557693 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.557927 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.558040 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.558279 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.558379 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.558655 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.558785 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559039 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559140 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559388 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559494 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559738 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.559840 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560086 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560186 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560440 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560539 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560779 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.560880 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561135 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561240 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561476 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561575 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561824 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.561965 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562188 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562288 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562530 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562629 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562892 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.562993 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.563236 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.563335 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.563588 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.563698 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.563925 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564026 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564286 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564386 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564633 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564744 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.564978 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.565078 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.565338 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.565466 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.565685 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.565792 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566053 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566155 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566422 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566521 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566759 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.566870 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567106 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567206 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567445 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567545 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567794 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.567899 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568139 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568239 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568483 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568583 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568840 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.568941 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.569196 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.569296 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.569550 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.569637 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.569917 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570026 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570276 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570392 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570618 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570725 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.570964 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.571064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.571311 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.571419 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.571667 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.571774 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572005 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572105 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572357 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572457 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572693 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.572805 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573040 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573140 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573393 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573498 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573738 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.573869 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574125 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574224 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574509 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574610 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574874 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.574981 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.575240 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.575339 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.575616 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.575716 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.575956 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576057 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576335 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576467 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576694 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576794 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.576971 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85669) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:09:01.577072 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.577425 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.577806 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:09:01.578117 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85670) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:09:01.613006 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85669) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:01.613276 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85670) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:01.954175 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.context [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cecd9116-c8b8-41d1-8929-5acfc4f1558c(cell1) {{(pid=85669) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:09:01.954772 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.context [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cecd9116-c8b8-41d1-8929-5acfc4f1558c(cell1) {{(pid=85670) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:09:01.959704 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85669) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:01.960306 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:01.961679 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85669) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:01.962309 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:01.962592 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85669) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:01.963193 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:09:01.964738 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85669) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:01.965368 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:09:01.991697 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85669) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:01.996604 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85670) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:01.997943 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85670) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:02.001195 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85669) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:02.027329 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85669) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:02.029117 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_db.sqlalchemy.engines [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85670) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:09:02.125252 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:09:02.125252 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: from cryptography.utils import int_from_bytes Apr 20 19:09:02.125543 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:09:02.125543 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: from cryptography.utils import int_from_bytes Apr 20 19:09:02.125719 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:09:02.125719 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: from cryptography.utils import int_from_bytes Apr 20 19:09:02.125961 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:09:02.125961 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: from cryptography.utils import int_from_bytes Apr 20 19:09:02.202019 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading Gnome Apr 20 19:09:02.202664 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading Gnome Apr 20 19:09:02.223487 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading Google Apr 20 19:09:02.223764 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading Google Apr 20 19:09:02.226777 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading Windows (alt) Apr 20 19:09:02.227218 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading Windows (alt) Apr 20 19:09:02.231532 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading file Apr 20 19:09:02.231910 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading file Apr 20 19:09:02.232619 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading keyczar Apr 20 19:09:02.233018 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading keyczar Apr 20 19:09:02.233159 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading multi Apr 20 19:09:02.233476 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading multi Apr 20 19:09:02.233926 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Loading pyfs Apr 20 19:09:02.234384 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO keyring.backend [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Loading pyfs Apr 20 19:09:02.507694 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:09:02.509515 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:09:02.515618 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:09:02.517056 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:09:02.846633 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:09:02.851705 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:09:02.852568 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:09:02.857481 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WARNING keystonemiddleware.auth_token [None req-5ccd02d5-9f19-4428-b7ea-1298e1a1d296 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:09:02.859006 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea3d4ac9c0 pid: 85669 (default app) Apr 20 19:09:02.861215 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:09:02.862460 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001832 Apr 20 19:09:02.862902 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 779 bytes} [Tue Apr 20 19:09:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:09:02.863845 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea3d4ac9c0 pid: 85670 (default app) Apr 20 19:10:28.503595 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:28.504668 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Apr 20 19:10:28.505084 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:28.997176 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-c728c67e-6c15-4058-9f7c-02be62eb1351 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:29.024674 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-c728c67e-6c15-4058-9f7c-02be62eb1351 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.511479 Apr 20 19:10:29.025619 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1281 bytes} [Tue Apr 20 19:10:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:31.504188 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:31.505391 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-55b6e582-9950-449d-9395-dd17a9ebd298 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Apr 20 19:10:31.506137 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:31.567668 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-eaa8b1fc-8014-4487-b225-e876c131949c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:31.591148 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:10:31.591148 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:10:31.619705 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-eaa8b1fc-8014-4487-b225-e876c131949c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106593 Apr 20 19:10:31.620949 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:10:31.927422 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-b2533d80-748a-48e6-be18-b640988ef75c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:31.930940 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:10:31.930940 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:10:31.975819 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-b2533d80-748a-48e6-be18-b640988ef75c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.345764 Apr 20 19:10:31.977576 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1325 bytes} [Tue Apr 20 19:10:31 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:34.490163 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-eaa8b1fc-8014-4487-b225-e876c131949c admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:34.491940 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-eaa8b1fc-8014-4487-b225-e876c131949c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Apr 20 19:10:34.492498 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:34 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:34.615667 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-4082779e-2a7f-4751-b46b-80951425e497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:34.638558 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:10:34.638558 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:10:34.668327 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-4082779e-2a7f-4751-b46b-80951425e497 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168718 Apr 20 19:10:34.669009 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:34.682150 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-304caea7-f452-45ac-9984-d469c33c5e08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:34.684268 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:10:34.684268 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:10:34.723422 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-304caea7-f452-45ac-9984-d469c33c5e08 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045247 Apr 20 19:10:34.724161 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1325 bytes} [Tue Apr 20 19:10:34 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:37.248569 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-4082779e-2a7f-4751-b46b-80951425e497 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:37.249660 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-4082779e-2a7f-4751-b46b-80951425e497 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Apr 20 19:10:37.250070 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:37.319956 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-cedcc424-61db-4ded-82df-da3bae83de44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "vcpus": 1, "swap": 0, "id": "d2"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:37.348762 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-cedcc424-61db-4ded-82df-da3bae83de44 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.092054 Apr 20 19:10:37.349709 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:37.364774 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-ae058fd7-f58d-49de-82be-8366b2c7a128 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:37.404882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-ae058fd7-f58d-49de-82be-8366b2c7a128 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044517 Apr 20 19:10:37.405495 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1325 bytes} [Tue Apr 20 19:10:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:39.936833 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-cedcc424-61db-4ded-82df-da3bae83de44 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:39.938003 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-cedcc424-61db-4ded-82df-da3bae83de44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Apr 20 19:10:39.938710 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:40.003550 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-c6828744-b6d5-4757-a001-c1577c0fa3cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "vcpus": 2}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:40.029584 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-c6828744-b6d5-4757-a001-c1577c0fa3cd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084382 Apr 20 19:10:40.030216 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:40.043116 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-f52c582e-0b49-4c18-b84b-5a3cf4df2138 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:40.080784 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-f52c582e-0b49-4c18-b84b-5a3cf4df2138 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041504 Apr 20 19:10:40.094706 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1325 bytes} [Tue Apr 20 19:10:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:42.568526 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-c6828744-b6d5-4757-a001-c1577c0fa3cd admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:42.569615 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-c6828744-b6d5-4757-a001-c1577c0fa3cd admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Apr 20 19:10:42.570241 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:42.637444 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:42.663272 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086511 Apr 20 19:10:42.664042 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:42.677698 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-382041f8-01c4-468a-9a6b-47b317f7cbf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:42.714837 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-382041f8-01c4-468a-9a6b-47b317f7cbf0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041051 Apr 20 19:10:42.716053 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1325 bytes} [Tue Apr 20 19:10:42 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:45.328656 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:45.330301 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Apr 20 19:10:45.330814 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:45 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:45.410290 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-b6a19b3c-5fe5-4b18-8f71-e9a30e1bc452 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:45.436748 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-b6a19b3c-5fe5-4b18-8f71-e9a30e1bc452 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097136 Apr 20 19:10:45.437411 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1281 bytes} [Tue Apr 20 19:10:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:10:47.994364 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:47.995516 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-8ac817cc-5f3f-474d-bd9a-8cf6c8d7002e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Apr 20 19:10:47.995944 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:48.070163 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-fcb214c9-bc99-4406-86d8-91e8021f2bac admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:48.096973 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-fcb214c9-bc99-4406-86d8-91e8021f2bac admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093744 Apr 20 19:10:48.097591 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:48.112325 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-bcecd096-ee2b-44a1-beae-4a0b45051a84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:48.149544 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-bcecd096-ee2b-44a1-beae-4a0b45051a84 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041519 Apr 20 19:10:48.150257 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1322 bytes} [Tue Apr 20 19:10:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:50.660215 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-fcb214c9-bc99-4406-86d8-91e8021f2bac admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:50.661325 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-fcb214c9-bc99-4406-86d8-91e8021f2bac admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Apr 20 19:10:50.661767 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:50.724739 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-a494f461-b2b0-4783-8ce2-2f1844c4ae1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:50.753051 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-a494f461-b2b0-4783-8ce2-2f1844c4ae1d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084404 Apr 20 19:10:50.753769 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:50.767148 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-a85b3572-7692-4052-844b-15aedd562483 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:50.803546 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-a85b3572-7692-4052-844b-15aedd562483 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040460 Apr 20 19:10:50.804177 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1322 bytes} [Tue Apr 20 19:10:50 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:53.277431 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-a494f461-b2b0-4783-8ce2-2f1844c4ae1d admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:53.278669 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-a494f461-b2b0-4783-8ce2-2f1844c4ae1d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Apr 20 19:10:53.279110 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:53.339944 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-255763fc-8208-4515-adc2-8750bc208260 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "ram": 4096}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:53.366695 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-255763fc-8208-4515-adc2-8750bc208260 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080631 Apr 20 19:10:53.367281 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:53 2021] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:53.380396 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-bed10971-90fd-4fd5-8d70-d5bd95d7e3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:53.416448 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-bed10971-90fd-4fd5-8d70-d5bd95d7e3d4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040066 Apr 20 19:10:53.417064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1322 bytes} [Tue Apr 20 19:10:53 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:55.931573 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-255763fc-8208-4515-adc2-8750bc208260 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:55.932625 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-255763fc-8208-4515-adc2-8750bc208260 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Apr 20 19:10:55.933303 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:56.000098 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-5b479de3-91c3-4bea-a389-85dec83b7773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:56.026261 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-5b479de3-91c3-4bea-a389-85dec83b7773 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086185 Apr 20 19:10:56.034724 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:56.040263 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-559e8460-b1f7-4110-9e6c-e7cabcba0e72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:56.105920 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-559e8460-b1f7-4110-9e6c-e7cabcba0e72 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069593 Apr 20 19:10:56.106916 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1322 bytes} [Tue Apr 20 19:10:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:10:58.656329 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-5b479de3-91c3-4bea-a389-85dec83b7773 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:10:58.658150 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-5b479de3-91c3-4bea-a389-85dec83b7773 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Apr 20 19:10:58.658571 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:10:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:10:58.724850 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5"}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:58.752736 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086742 Apr 20 19:10:58.753298 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1272 bytes} [Tue Apr 20 19:10:58 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:10:58.766058 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-d9a84191-0f0b-44b0-9478-ade1884c6854 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:10:58.817861 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-d9a84191-0f0b-44b0-9478-ade1884c6854 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043483 Apr 20 19:10:58.817861 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1322 bytes} [Tue Apr 20 19:10:58 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:11:39.059828 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:39.060900 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Apr 20 19:11:39.061289 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 920 bytes} [Tue Apr 20 19:11:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:39.129442 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-667a45fe-d017-4093-9f9b-74b6615d8ad8 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:39.154768 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-667a45fe-d017-4093-9f9b-74b6615d8ad8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.086427 Apr 20 19:11:39.155338 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1281 bytes} [Tue Apr 20 19:11:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:40.827454 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:40.828617 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6daf21fd-43e8-4bbe-b868-8d62912a6311 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Apr 20 19:11:40.829071 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:41.014719 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-b403d3e9-5a5f-45a2-a0e1-dfca7f1bc642 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:41.029321 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-b403d3e9-5a5f-45a2-a0e1-dfca7f1bc642 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 19:11:41.029896 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-b403d3e9-5a5f-45a2-a0e1-dfca7f1bc642 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:41.030794 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-b403d3e9-5a5f-45a2-a0e1-dfca7f1bc642 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.073612 Apr 20 19:11:41.031366 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1181 bytes} [Tue Apr 20 19:11:40 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:41.041885 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-2eaf18c5-72c4-453d-96ef-9b70b48aa76b admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:41.064167 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-2eaf18c5-72c4-453d-96ef-9b70b48aa76b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026179 Apr 20 19:11:41.064760 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:41.075847 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-dbc0c554-953e-4c19-9168-ed7b9116fbd2 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:41.097582 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-dbc0c554-953e-4c19-9168-ed7b9116fbd2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025691 Apr 20 19:11:41.098259 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:41.109035 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-ec81d428-5a1d-47c9-8336-b32bf86a4c4d admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:41.123679 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-ec81d428-5a1d-47c9-8336-b32bf86a4c4d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 19:11:41.124304 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-ec81d428-5a1d-47c9-8336-b32bf86a4c4d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:41.125139 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-ec81d428-5a1d-47c9-8336-b32bf86a4c4d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.020023 Apr 20 19:11:41.125675 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1181 bytes} [Tue Apr 20 19:11:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:42.690457 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-dbc0c554-953e-4c19-9168-ed7b9116fbd2 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:42.691599 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-dbc0c554-953e-4c19-9168-ed7b9116fbd2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Apr 20 19:11:42.692040 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:42.887587 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-1e8b8d2c-68b7-4fef-9dbd-d9d0fbb34c66 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:42.901184 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-1e8b8d2c-68b7-4fef-9dbd-d9d0fbb34c66 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 19:11:42.901804 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-1e8b8d2c-68b7-4fef-9dbd-d9d0fbb34c66 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:42.902702 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-1e8b8d2c-68b7-4fef-9dbd-d9d0fbb34c66 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.083340 Apr 20 19:11:42.903258 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1181 bytes} [Tue Apr 20 19:11:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:42.913637 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-49d8094b-81ea-4a8a-bcdf-737547fb6b12 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:42.935882 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-49d8094b-81ea-4a8a-bcdf-737547fb6b12 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026173 Apr 20 19:11:42.936444 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:42.949270 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-f8daac40-f35e-4c44-beaa-43dba5f124fa admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:42.973975 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-f8daac40-f35e-4c44-beaa-43dba5f124fa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.030680 Apr 20 19:11:42.974532 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:42.985047 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-7e5ce561-52a0-452b-b19b-2b5dae85a62d admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:42.997898 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-7e5ce561-52a0-452b-b19b-2b5dae85a62d admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 19:11:42.998527 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-7e5ce561-52a0-452b-b19b-2b5dae85a62d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:42.999335 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-7e5ce561-52a0-452b-b19b-2b5dae85a62d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018140 Apr 20 19:11:42.999867 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1181 bytes} [Tue Apr 20 19:11:42 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:44.553806 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-f8daac40-f35e-4c44-beaa-43dba5f124fa admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:44.554934 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-f8daac40-f35e-4c44-beaa-43dba5f124fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Apr 20 19:11:44.555389 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:44.747452 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-55209a46-7525-4aac-bf54-ca761ec2afef admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:44.760461 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-55209a46-7525-4aac-bf54-ca761ec2afef admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 19:11:44.761017 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-55209a46-7525-4aac-bf54-ca761ec2afef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:44.761895 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-55209a46-7525-4aac-bf54-ca761ec2afef admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.081439 Apr 20 19:11:44.762453 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1184 bytes} [Tue Apr 20 19:11:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:44.773387 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-c9d2c45e-bdea-40a8-bec2-ecc04d4b4317 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:44.795740 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-c9d2c45e-bdea-40a8-bec2-ecc04d4b4317 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026345 Apr 20 19:11:44.796302 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:11:44.806963 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:44.828806 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025700 Apr 20 19:11:44.829424 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1201 bytes} [Tue Apr 20 19:11:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:11:44.845131 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-736b9f78-36f0-4834-bb7f-78a9cc88e954 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:44.859663 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.wsgi [None req-736b9f78-36f0-4834-bb7f-78a9cc88e954 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 19:11:44.860259 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-736b9f78-36f0-4834-bb7f-78a9cc88e954 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:11:44.861123 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-736b9f78-36f0-4834-bb7f-78a9cc88e954 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.022090 Apr 20 19:11:44.861673 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1184 bytes} [Tue Apr 20 19:11:44 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:11:46.413471 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:46.414606 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 20 19:11:46.415069 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:46.606184 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-dcf2d5c7-83e3-4022-9266-5fb402e34cfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:46.635109 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-dcf2d5c7-83e3-4022-9266-5fb402e34cfa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.093368 Apr 20 19:11:46.635618 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1226 bytes} [Tue Apr 20 19:11:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:11:48.198059 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:48.199142 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Apr 20 19:11:48.199580 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:48.407511 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-8926d0eb-beec-4b4f-827b-a0c204c0fcaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:48.436987 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-8926d0eb-beec-4b4f-827b-a0c204c0fcaa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.098366 Apr 20 19:11:48.437565 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1226 bytes} [Tue Apr 20 19:11:48 2021] POST /compute/v2.1/flavors => generated 405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:11:50.004694 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:50.005781 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Apr 20 19:11:50.006284 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:50.203102 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-ea79e79c-310a-42d2-9c1f-d3a4ed4becf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:50.229684 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-ea79e79c-310a-42d2-9c1f-d3a4ed4becf0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.091192 Apr 20 19:11:50.230344 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1226 bytes} [Tue Apr 20 19:11:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:11:51.808632 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:51.810133 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Apr 20 19:11:51.810735 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:51 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:51.999347 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6c5c32e3-7e1c-46d9-8317-6c6b095a9526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:11:52.027197 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6c5c32e3-7e1c-46d9-8317-6c6b095a9526 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.087264 Apr 20 19:11:52.027685 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1226 bytes} [Tue Apr 20 19:11:51 2021] POST /compute/v2.1/flavors => generated 409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:11:53.588154 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:53.589239 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Apr 20 19:11:53.589675 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:11:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:11:53.783209 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-8beee791-eda1-4260-8f47-c35665e136e1 admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:11:53.810993 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-8beee791-eda1-4260-8f47-c35665e136e1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.094500 Apr 20 19:11:53.811579 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Apr 20 19:11:53 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:12:44.547596 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:12:44.548710 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0cd0aa5a-04ce-4be5-86b5-9a2d985266ba admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Apr 20 19:12:44.549134 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 31/63] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:12:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:12:44.747040 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:12:44.774776 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.098176 Apr 20 19:12:44.775358 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Apr 20 19:12:44 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:14:10.357023 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-0ba3b22b-8ab2-489a-a4e9-08c5d16255b9 tempest-verify_tempest_config-46019376 tempest-verify_tempest_config-46019376-project] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:14:10.359516 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-0ba3b22b-8ab2-489a-a4e9-08c5d16255b9 tempest-verify_tempest_config-46019376 tempest-verify_tempest_config-46019376-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.131638 Apr 20 19:14:10.360083 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1124 bytes} [Tue Apr 20 19:14:10 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:15:45.722086 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:15:45.723214 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Apr 20 19:15:45.723686 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 34/66] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:15:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:15:46.006051 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:15:46.008095 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:15:46.008095 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:15:46.010646 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:15:46.011348 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:15:46.012380 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:15:46.012850 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:15:46.051936 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-30c4f308-b907-4769-8289-736a8edf843a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.200016 Apr 20 19:15:46.053676 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1184 bytes} [Tue Apr 20 19:15:45 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:15:47.617365 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] Calling method '>' {{(pid=85669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:15:47.618474 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-6e0692cb-a5bd-4d53-9876-1f9ff777914f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Apr 20 19:15:47.618912 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85669|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1065 bytes} [Tue Apr 20 19:15:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:15:47.823451 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG nova.api.openstack.wsgi [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] Calling method '>' {{(pid=85670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:15:47.824891 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:15:47.824891 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: warnings.warn(msg) Apr 20 19:15:47.826564 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:15:47.827064 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:15:47.827911 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:15:47.828385 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: DEBUG oslo_concurrency.lockutils [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85670) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:15:47.858567 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: INFO nova.api.openstack.requestlog [None req-d3269c1f-7ee6-45ce-aaa7-87db9cce8d34 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.106317 Apr 20 19:15:47.859150 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: [pid: 85670|app: 0|req: 34/69] 10.222.0.48 () {60 vars in 1184 bytes} [Tue Apr 20 19:15:47 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:16:44.676376 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: Tue Apr 20 19:16:44 2021 - graceful shutdown triggered... Apr 20 19:16:44.677035 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: Gracefully killing worker 1 (pid: 85669)... Apr 20 19:16:44.677182 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: Gracefully killing worker 2 (pid: 85670)... Apr 20 19:16:44.677659 dv-cinder-786933-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 20 19:16:45.677602 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: worker 1 buried after 1 seconds Apr 20 19:16:45.677602 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: worker 2 buried after 1 seconds Apr 20 19:16:45.677602 dv-cinder-786933-2-iscsi devstack@n-api.service[85668]: goodbye to uWSGI. Apr 20 19:16:45.679416 dv-cinder-786933-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 20 19:16:45.681120 dv-cinder-786933-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 19:16:45.689203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 19:16:45 2021] *** Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: nodename: dv-cinder-786933-2-iscsi Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: machine: x86_64 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: clock source: unix Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: pcre jit disabled Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: detected number of CPU cores: 4 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: current working directory: / Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: detected binary path: /usr/bin/uwsgi-core Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: dropping root privileges as early as possible Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: your processes number limit is 47843 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: your memory page size is 4096 bytes Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: detected max file descriptor number: 2048 Apr 20 19:16:45.691298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: lock engine: pthread robust mutexes Apr 20 19:16:45.692276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: thunder lock: enabled Apr 20 19:16:45.692276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 19:16:45.692276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: dropping root privileges after socket binding Apr 20 19:16:45.692276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 19:16:45.736866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Python main interpreter initialized at 0x562ec80969c0 Apr 20 19:16:45.736866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: dropping root privileges after plugin initialization Apr 20 19:16:45.736866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: python threads support enabled Apr 20 19:16:45.736866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: your server socket listen backlog is limited to 100 connections Apr 20 19:16:45.736866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: your mercy for graceful operations on workers is 90 seconds Apr 20 19:16:45.737394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 19:16:45.737394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: *** Operational MODE: preforking *** Apr 20 19:16:45.737565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: dropping root privileges after application loading Apr 20 19:16:45.737565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: *** uWSGI is running in multiple interpreter mode *** Apr 20 19:16:45.737565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: spawned uWSGI master process (pid: 100512) Apr 20 19:16:45.737665 dv-cinder-786933-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 19:16:45.738544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: spawned uWSGI worker 1 (pid: 100514, cores: 1) Apr 20 19:16:45.738544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: spawned uWSGI worker 2 (pid: 100515, cores: 1) Apr 20 19:16:45.738544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 19:16:50.866640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:16:50.867215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:16:50.868584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:16:50.869036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:16:50.869398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:16:50.869781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.870182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.870522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.870912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.871432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.871664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.872007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.872375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.872748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.873052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.873356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.873969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786933-2-iscsi {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.874371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.874698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.875054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.875426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.875774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.876151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.876486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.877127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.877481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.877858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.878207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.878733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.879100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.879455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.879825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.880176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.880552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.880912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.881280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786933-2-iscsi {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.881644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.882037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.882680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.884442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.884804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.885162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.885537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.885939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.886298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.886686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.887060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.887429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.887799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.888142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.888493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.888846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.889208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.889555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.889929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.890220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.890568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.890939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.891343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.891666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.891957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.892245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.892610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.892979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.893329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.893677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.894059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.894458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.894807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.895155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.895501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.895846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.896212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.896576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.896962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.897307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.897671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.898171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.898461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.898816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.899205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.899570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.899920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.900284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.900652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.900998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.901347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.901694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.902090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.902559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.902786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.903073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.903411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.903753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.904117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.904460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.904804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.905151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.905489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.905892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.906244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.906584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.906934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.907277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.907609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.907935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.908281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.908605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.908972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.909336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.909678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.910100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.910466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.910815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.911177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.911526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.911878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.912237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.912566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.912913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.913278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.913625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.913994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.914358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.914696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.915043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.915388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.915953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.916290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.916633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.916981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.917479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.917647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.918011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.918370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.918711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.919070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.919438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.919788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.920136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.920479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.920842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.921223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.921603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.922018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.922359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.922744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.923120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.923479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.923833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.924187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.924560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.924911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.925263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.925740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.926147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.926507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.926888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.927244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.927602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.927706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:16:50.927960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.928063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:16:50.928310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.928668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.929039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.929401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.929558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:16:50.929759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.930025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:16:50.930181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.930295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:16:50.930573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.930766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.930926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.931141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.931298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.931508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.931652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.931877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.931990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.932261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.932371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.932618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.932727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.932987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.933091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.933347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.933461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.933700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.933810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.934025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.934132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.934391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.934508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.934769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786933-2-iscsi {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.934875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.935120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.935234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.935467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.935579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.935812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.935924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.936157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.936276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.936500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.936603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.936843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.936945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.937197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.937307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.937569 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.937845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.937976 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.938204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.938318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.938625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.938728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.938975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.939085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.939324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.939676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.940033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.940199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.940386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.940549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.940728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.940888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.941219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.941321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.941491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.941589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.941820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.942011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.942210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.942316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.942554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.942657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786933-2-iscsi {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.942898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.942993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.943290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.943394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.943585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.943701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.943937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.944157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.944254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.944630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.944751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.944982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.945089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.945333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.945440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.945701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.945927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.946095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.946247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.946421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.946575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.946799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.946961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.947207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.947404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.947525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.947651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.947891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.948012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.948208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.948365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.948555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.948714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.948876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.948981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.949213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.949361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.949562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.949771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.949933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.950050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.950209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.950320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.950564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.950724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.950884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.951013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.951258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.951418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.951533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.951634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.951818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.952029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.952152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.952262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.952522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.952684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.952850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.952970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.953240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.953389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.953594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.953743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.953935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.954050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.954292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.954451 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.954609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.954723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.954985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.955142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.955332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.955440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.955652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.955774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.955999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.956167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.956351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.956457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.956695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.956821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.957066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.957187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.957417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.957629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.957749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.957946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.958114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.958283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.958474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.958670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.958853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.959039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.959158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.959394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.959500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.959762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.959925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.960133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.960249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.960482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.960598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.960831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.960950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.961171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.961278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.961497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.961599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.961892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.962011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.962215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.962323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.962505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.962614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.962850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.962954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.963199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.963303 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.963549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.963659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.963894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.964004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.964237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.964339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.964580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.964680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.964924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.965027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.965275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.965380 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.965621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.965732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.966010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.966126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.966379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.966509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.966726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.966828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.967072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.967200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.967464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.967665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.967795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.968021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.968153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.968369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.968492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.968721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.968848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.969062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.969183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.969456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.969594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.969806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.970094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.970210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.970322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.970503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.970632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.970846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.970975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.971192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.971313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.973879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.973998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.974902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.974980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.975873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.975952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.976032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.976506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.976612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.976693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.976773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.976852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.976941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.977580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.977668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.977740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.978088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.978178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.978261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.978334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.978744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.978842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.978924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.979005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.979300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.979398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.979669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:16:50.979804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.980827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.981912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.982124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.982239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.982791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.982898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.982975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.983894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.984846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.985909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.986160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.986266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.986510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.986613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.986938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.987923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.988249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.988344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.988596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.988699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.988976 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.989071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.989348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.989444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.989742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.989868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.990145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.990250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.990428 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.990520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.991880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.992133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.992240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.992475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.992602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.993626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.994876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.995992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.996149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.996300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.996503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.996655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.996863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.997943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.998846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:50.999860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.000864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.001912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.002812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.003398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.003567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.003763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.003916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.004947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.005951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.006987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.007982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.008873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.009947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.010959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.011126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.011294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.011543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.011704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.011856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.012999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.013617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.013772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.013953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.014870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.015900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.016943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.017938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.018899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.019967 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.020147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.020408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.020565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.020710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.020853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.021914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.022937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.023097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.023693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.023856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.024928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.025983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.026894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.027930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028428 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.028949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.029101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.029245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.029474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.029631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.029860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.030030 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.030241 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.030591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.030591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.030890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.031903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032061 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.032974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.033127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.033272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.033931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.034850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.035928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.036862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.037089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.037249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.037447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.037599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.038340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.038516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.038675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.038829 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.038974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.039868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.040945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.041872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.042957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.043107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.043253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.043405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.043778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.044996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.045938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.046990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.047905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.048888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.049771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.050124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.050286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.050432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.051880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.057997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.062902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.063955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.064863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.065785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.066863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.067902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.068880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.070338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.070508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.070669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.070817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.070969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.071954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.072874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.073164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.074338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.075438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.076541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.077644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.077644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.077644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.078904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.079224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.079942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.079942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.080232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.080483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.080644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.080791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.080949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.081895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.082967 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.083867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.084896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.085122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.085287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.085477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.085634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.085851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.086999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.087152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.087295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.087440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.087695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.087848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.088827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.089040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.089194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.089441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.090219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.090386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.090543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.090711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.090711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.091105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.091105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.091575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.091951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.092309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.092685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.093065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.093418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.093770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.094168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.094482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.094835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.095211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.095563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.095926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.096284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.096639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.096988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.097360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.097766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.098162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.098541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.098902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.099277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.099655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.100371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.100371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.100670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.101059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.101330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.101679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.102973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.103202 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.103362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.103584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.103736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.103939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.104097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.104387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.104547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.104721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.104996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.105150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.105354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.105515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.105727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.105907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.106933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.107128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.107281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.107482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.107646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.107832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.108857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.109011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.109201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.109354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.109645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.109805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.110471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.110471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.110781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.110928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.111528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.111952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.112316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.112694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.113097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.113463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.113814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.114232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.114586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.114936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.115298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.116020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.116369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.116718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.117072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.117427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.117775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.118255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.118604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.118983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.119333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.119770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.120032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.120651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.120811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.121036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.121388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.121740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.122405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.122554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.122710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.122863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.122863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.123229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.123229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.123536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.123689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.124028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.124507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.124877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.125214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.125378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.125575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.125727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.126871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.127964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.128167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.128318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.128524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.128742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.128949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.129102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.129320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.129471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.129697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.130065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.130228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.130854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.131869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.132878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.133997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.134163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.134325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.134482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.134634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.134868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.135963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.136146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.136294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.136501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.136655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.136865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.137980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.138144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.138334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.138495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.138688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.138846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139042 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.139901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.140140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.140298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.140460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.141902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.142959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143412 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.143875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.144869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.145902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.146289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.146443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.146644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.146808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.147969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.148968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.149135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.149280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.149465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.149624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.149825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.150001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.150171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.150388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.150539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.150712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.151281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.151443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.151605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.151751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.151910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.152802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.153867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.154938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.155101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.155317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.155468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.155620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.155858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.156966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.157169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.157322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.157526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.157690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.157873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.158955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.159100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.159251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.159397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.159609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.159830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.160890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.161472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.161635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.161790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.162896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163496 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.163953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.164915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.165930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.166984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.167153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.167335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.167493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100515) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:16:51.167903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.167903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.167903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.168533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.168918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.169366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.169685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.170132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.170487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.170841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.171486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.171661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.172828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.172828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.172828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.173348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.173501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.173802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.174208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.174565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.174921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.175277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.175737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.176105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.176467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.176835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.177199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.177563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.178239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.178239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.178616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.178980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.179363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.179707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.180361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.180537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.180898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.181266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.181633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.182017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.182403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.182799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.183178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.183573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.183923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.184273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.184622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.184976 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.185372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.185765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.187150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.187544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.187936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.188306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.188671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.189036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.189398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.189761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.190168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.190538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.190910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.191300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.191679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.192039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.192409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.192763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.193126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.193493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.193868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.194268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.194632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.195011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.195369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.195743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.196106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.196478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.196852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.197220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.197583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.197997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.198855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.198855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.199174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.199372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.199728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.200088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.200470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.200845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.201779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.201779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.202751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.203080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.203354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.203716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.204102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.204462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.205037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.205140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100515) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.205232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.205501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.205886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.206258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.206634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.207075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.207449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.208305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.208305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.208544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.208928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.209311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:16:51.209598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100514) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:16:51.248772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100514) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.470244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.context [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cecd9116-c8b8-41d1-8929-5acfc4f1558c(cell1) {{(pid=100515) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:16:51.476388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:16:51.478420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:16:51.479741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:16:51.482075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:16:51.509221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100515) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.510699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100515) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.513417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.context [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cecd9116-c8b8-41d1-8929-5acfc4f1558c(cell1) {{(pid=100514) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:16:51.519183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:16:51.521127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:16:51.522115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:16:51.524300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:16:51.543181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100515) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.554405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100514) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.555813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100514) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.587001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100514) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:16:51.629119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:16:51.629119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: from cryptography.utils import int_from_bytes Apr 20 19:16:51.629664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:16:51.629664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: from cryptography.utils import int_from_bytes Apr 20 19:16:51.670477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:16:51.670477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: from cryptography.utils import int_from_bytes Apr 20 19:16:51.670859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:16:51.670859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: from cryptography.utils import int_from_bytes Apr 20 19:16:51.706075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading Gnome Apr 20 19:16:51.726730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading Google Apr 20 19:16:51.730045 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading Windows (alt) Apr 20 19:16:51.734844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading file Apr 20 19:16:51.735924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading keyczar Apr 20 19:16:51.736376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading multi Apr 20 19:16:51.737245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Loading pyfs Apr 20 19:16:51.748426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading Gnome Apr 20 19:16:51.769141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading Google Apr 20 19:16:51.772614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading Windows (alt) Apr 20 19:16:51.777504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading file Apr 20 19:16:51.778647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading keyczar Apr 20 19:16:51.779099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading multi Apr 20 19:16:51.779986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO keyring.backend [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Loading pyfs Apr 20 19:16:52.014178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:16:52.021311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:16:52.060784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:16:52.068431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:16:52.361246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:16:52.367319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-d2e4ba53-461f-4a10-88bc-0f97a4d93f9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:16:52.373297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562ec80969c0 pid: 100515 (default app) Apr 20 19:16:52.410326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:16:52.416098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WARNING keystonemiddleware.auth_token [None req-b4cc97e7-a1cf-4128-a74a-80dc7e379126 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:16:52.421790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562ec80969c0 pid: 100514 (default app) Apr 20 19:17:29.683981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3bd79dff-293d-494d-9534-c4c897430691 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Action: 'create', calling method: .version_select at 0x7fd8e18052f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1056075253", "metadata": {"Type": "work"}}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:29.687878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3bd79dff-293d-494d-9534-c4c897430691 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:29.689102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3bd79dff-293d-494d-9534-c4c897430691 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.076672 Apr 20 19:17:29.690229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Apr 20 19:17:28 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1079 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:17:30.002884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-572baad2-0ca4-43e0-86cc-75320a71f4b6 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Action: 'create', calling method: .version_select at 0x7fd8e18c2e18>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1753649785", "metadata": {"Type": "work"}}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:30.006367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-572baad2-0ca4-43e0-86cc-75320a71f4b6 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:30.007304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-572baad2-0ca4-43e0-86cc-75320a71f4b6 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.310266 Apr 20 19:17:30.008387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Apr 20 19:17:29 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:17:30.019134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f3b7bd39-ad6d-4ce5-b8ad-8fff12c72e09 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Action: 'create', calling method: .version_select at 0x7fd8e1805d08>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081636490", "metadata": {"Type": "work"}}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:30.021714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f3b7bd39-ad6d-4ce5-b8ad-8fff12c72e09 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:30.023683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f3b7bd39-ad6d-4ce5-b8ad-8fff12c72e09 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008810 Apr 20 19:17:30.024726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Apr 20 19:17:30 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 19:17:30.040053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f870b34e-a372-43d7-a620-1049f909854d tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Calling method '.version_select at 0x7fd8e16ce950>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:30.503511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-f870b34e-a372-43d7-a620-1049f909854d tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] HTTP exception thrown: Volume tempest-invalid-1720182611 could not be found. Apr 20 19:17:30.504353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f870b34e-a372-43d7-a620-1049f909854d tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 404 to user: Volume tempest-invalid-1720182611 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:30.505271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f870b34e-a372-43d7-a620-1049f909854d tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1720182611" status: 404 len: 99 microversion: 2.1 time: 0.475098 Apr 20 19:17:30.506138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1208 bytes} [Tue Apr 20 19:17:30 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1720182611 => generated 99 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:17:30.516488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bd58ce95-dedb-4c79-ae1e-677be7c980a4 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004028 Apr 20 19:17:30.517188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1130 bytes} [Tue Apr 20 19:17:30 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 19:17:30.527265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0252a23a-094b-4ef1-9567-6dc811700e52 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004705 Apr 20 19:17:30.532066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1127 bytes} [Tue Apr 20 19:17:30 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 19:17:30.543091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8743d1f3-40b0-4c9b-a8d8-86664fe6f2eb tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Calling method '.version_select at 0x7fd8e1805f28>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:30.775620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-8743d1f3-40b0-4c9b-a8d8-86664fe6f2eb tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] HTTP exception thrown: Volume 6e299bf5-9f30-4b07-bd26-957a2c8a941f could not be found. Apr 20 19:17:30.776385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8743d1f3-40b0-4c9b-a8d8-86664fe6f2eb tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 404 to user: Volume 6e299bf5-9f30-4b07-bd26-957a2c8a941f could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:30.778180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8743d1f3-40b0-4c9b-a8d8-86664fe6f2eb tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/6e299bf5-9f30-4b07-bd26-957a2c8a941f" status: 404 len: 109 microversion: 2.1 time: 0.239153 Apr 20 19:17:30.779516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:17:30 2021] DELETE /compute/v2.1/os-volumes/6e299bf5-9f30-4b07-bd26-957a2c8a941f => generated 109 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:17:30.807593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-799860e8-0406-4a16-88fa-2c8047c1f905 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Calling method '.version_select at 0x7fd8e16e7f28>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:30.895759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-799860e8-0406-4a16-88fa-2c8047c1f905 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] HTTP exception thrown: Volume a614412b-fe44-46cc-95fc-0845a3991590 could not be found. Apr 20 19:17:30.896456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-799860e8-0406-4a16-88fa-2c8047c1f905 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] Returning 404 to user: Volume a614412b-fe44-46cc-95fc-0845a3991590 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:17:30.897403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-799860e8-0406-4a16-88fa-2c8047c1f905 tempest-VolumesNegativeTest-733289415 tempest-VolumesNegativeTest-733289415-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a614412b-fe44-46cc-95fc-0845a3991590" status: 404 len: 109 microversion: 2.1 time: 0.102268 Apr 20 19:17:30.898253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:17:30 2021] GET /compute/v2.1/os-volumes/a614412b-fe44-46cc-95fc-0845a3991590 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:17:32.485897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-258161103", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "f9c0d1ee-9f89-446d-946e-0a07de689a6b"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:32.610608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] validate_networks() for [('f9c0d1ee-9f89-446d-946e-0a07de689a6b', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:17:33.340809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:17:33.341292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:17:33.341821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:17:33.342345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:17:33.342791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:17:33.354609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:33.355448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:33.356641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:33.357168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:33.379980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Getting quotas for project cbf6133fbc814cb1881e1239159e0568. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:17:33.385197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Getting quotas for user a16061c24ab9474d8c85faaa9586883c and project cbf6133fbc814cb1881e1239159e0568. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:17:33.398523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:17:33.401774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:17:33.514421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1046d3b0-1768-44a9-93d3-dee587000d78 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221207 Apr 20 19:17:33.518553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 5/9] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:17:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:17:33.531420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2eed1e06-5e92-4e3d-87f9-bbf6d154c23e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:33.532229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2eed1e06-5e92-4e3d-87f9-bbf6d154c23e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:33.714499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2eed1e06-5e92-4e3d-87f9-bbf6d154c23e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:33.730150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2eed1e06-5e92-4e3d-87f9-bbf6d154c23e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1214 microversion: 2.1 time: 0.203602 Apr 20 19:17:33.730759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 5/10] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:33 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:34.750950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06f2497a-89e8-4b68-b9a9-9318a6d07bab tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:34.753109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06f2497a-89e8-4b68-b9a9-9318a6d07bab tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:34.989177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06f2497a-89e8-4b68-b9a9-9318a6d07bab tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:35.039326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06f2497a-89e8-4b68-b9a9-9318a6d07bab tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1214 microversion: 2.1 time: 0.292722 Apr 20 19:17:35.040483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:34 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:36.059078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:36.059761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:36.088737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:36.089255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:36.090172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:36.095103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:36.348120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2046595499", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "a3d56b3d-c47b-49ff-9e13-42db36c3dbd5"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:36.531895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] validate_networks() for [('a3d56b3d-c47b-49ff-9e13-42db36c3dbd5', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:17:36.891984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:36.911310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6e138702-f56f-4c42-ad30-74451471f6ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1218 microversion: 2.1 time: 0.856038 Apr 20 19:17:36.921430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:36 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1218 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:37.933907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:37.934586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:37.958630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:37.959208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:37.963498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:37.964012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:38.916316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:38.934269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-be7e27f5-8874-4cf0-9c4a-8eddf354a663 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1266 microversion: 2.1 time: 1.009279 Apr 20 19:17:38.946312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:37 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1266 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:17:39.954910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:39.956161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:39.989309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:39.989857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:40.012802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:40.025994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:41.991455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:42.010063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-05ba14ef-42d0-4b93-987a-6a54ab217cb8 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1272 microversion: 2.1 time: 2.061130 Apr 20 19:17:42.014607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 9/14] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:39 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1272 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:42.267610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:17:42.268248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:17:42.268917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:17:42.270471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:17:42.271203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:17:42.315748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:42.316259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:42.317123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:42.317610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:42.363598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:17:42.377026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for user 825e0fb1ce1741fd9735f09cd3da24b2 and project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:17:42.398727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:17:42.402420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:17:42.503861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7114179f-db2b-47af-a805-2167a4f4855f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.642174 Apr 20 19:17:42.504577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 6/15] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:17:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 6644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:17:42.519388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ee96e14e-1ff9-485f-b4b7-542b4803736d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:42.520782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ee96e14e-1ff9-485f-b4b7-542b4803736d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:43.034432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:43.035698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:43.083471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:43.084076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:43.095652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:43.096255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:43.289242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ee96e14e-1ff9-485f-b4b7-542b4803736d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:43.306733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ee96e14e-1ff9-485f-b4b7-542b4803736d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1218 microversion: 2.1 time: 0.791801 Apr 20 19:17:43.309517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 10/16] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:42 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1218 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:44.326971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:44.330330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:44.331019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:44.357479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-76dd0c05-21b2-441c-ac63-7dc31bad9bdd tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 1.324517 Apr 20 19:17:44.359521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 7/17] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:43 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:44.370773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:44.384260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:44.400137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:44.400680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:44.841535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:44.858119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-30afea16-e196-4604-b214-4c4b984eda99 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1222 microversion: 2.1 time: 0.534933 Apr 20 19:17:44.859183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 11/18] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:44 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1222 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:45.377688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:45.380581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:45.395582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:45.396092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:45.396983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:45.408453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:45.876776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:45.877454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:45.902918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:45.905491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:45.906940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:45.907449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:46.463407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:46.477199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c69dc30c-8151-478f-a52d-fba4aa9dff02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1270 microversion: 2.1 time: 0.604518 Apr 20 19:17:46.477877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 12/19] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:45 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1270 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:47.496430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:47.497085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:47.511969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:47.512753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:47.513803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:47.514528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:48.009002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:48.024154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-208fc497-799e-4093-81cb-cfc83ef710fc tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1288 microversion: 2.1 time: 0.532028 Apr 20 19:17:48.028649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 13/20] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:47 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1288 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:17:48.147512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:48.185155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c9b12d89-b6a9-4dd1-863b-4fec287d48aa tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 2.810810 Apr 20 19:17:48.187747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 8/21] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:45 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:48.784111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-62a5bf20-146e-4932-bc9a-79651fafb79e req-97a9ff39-186d-4275-b206-c4dd887b561b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092abfd7-6e6a-4c09-91bb-2884e1747d7c", "tag": "c97bca53-bcf6-4794-a9d1-87831540373f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:48.798229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:17:48.798229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:17:48.810942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-62a5bf20-146e-4932-bc9a-79651fafb79e req-97a9ff39-186d-4275-b206-c4dd887b561b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:48.811753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-62a5bf20-146e-4932-bc9a-79651fafb79e req-97a9ff39-186d-4275-b206-c4dd887b561b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:48.851798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-62a5bf20-146e-4932-bc9a-79651fafb79e req-97a9ff39-186d-4275-b206-c4dd887b561b service nova] Creating event network-changed:c97bca53-bcf6-4794-a9d1-87831540373f for instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c on hv-cinder-78693 Apr 20 19:17:48.852575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-62a5bf20-146e-4932-bc9a-79651fafb79e req-97a9ff39-186d-4275-b206-c4dd887b561b service nova] Acquired lock "compute-rpcapi-router" {{(pid=100515) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 19:17:48.854053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:48.854757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:48.855799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:48.856510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:48.868858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.compute.rpcapi [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 19:17:48.870966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] Releasing lock "compute-rpcapi-router" {{(pid=100515) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 19:17:48.912661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-478d0627-7f93-407d-b216-79b4676b0020 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282978 Apr 20 19:17:48.913854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 14/22] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:17:49.048542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:49.049750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:49.073275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:49.074585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:49.082666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:49.083672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:49.206456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:49.207674 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:49.225069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:49.225942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:49.227973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:49.235066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:49.540064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:49.556189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d77e89d-bdd3-4645-90e6-d2eff98f2334 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1288 microversion: 2.1 time: 0.513004 Apr 20 19:17:49.556807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 9/23] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:49 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1288 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:50.576250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:50.578277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:50.594786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:50.598936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:50.600302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:50.600998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:51.793191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:51.804305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ea47b5bb-30f2-46b3-bb5d-a5f6a229daf8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1276 microversion: 2.1 time: 1.233362 Apr 20 19:17:51.805104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 10/24] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:50 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1276 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:17:51.956258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:51.966094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e0e48330-4fae-4b27-9529-21074486b39e tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 2.764963 Apr 20 19:17:51.978853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 15/25] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:49 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:52.235717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: .version_select at 0x7fd8e0d192f0>, body: {"keypair": {"name": "tempest-keypair-645576227"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:52.339653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:17:52.349475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:17:52.659673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:17:52.670762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:17:52.708067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5d62415c-344a-4a93-83c4-a2ec92883ac6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.840430 Apr 20 19:17:52.709370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 11/26] 10.222.0.48 () {60 vars in 1148 bytes} [Tue Apr 20 19:17:51 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:52.823226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:52.824612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:52.838236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:52.841135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:52.845729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:52.846659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:53.079413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545673261", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54a87281-cac4-4c39-a9e0-64b8c916f808"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:53.238694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] validate_networks() for [('54a87281-cac4-4c39-a9e0-64b8c916f808', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:17:54.588912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:54.603878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3a451606-36b6-47b0-aa9e-75b9af6cc3b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 1.785133 Apr 20 19:17:54.604767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 12/27] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:52 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:54.615216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:54.618667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:54.637435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:54.642311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:54.643478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:54.644247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:56.242107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:56.256971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-57579260-9b73-4425-96d5-94e4b9ea0e8d tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 1.650585 Apr 20 19:17:56.257763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 13/28] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:54 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:56.264221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:56.265239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:56.267327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:17:56.267804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:17:56.268511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:17:56.269120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:17:56.270781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:17:56.276836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:56.277389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:56.278295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:56.279198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:56.285823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:56.286453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:56.296977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:56.297666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:56.342449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Getting quotas for project 7d47d9888e1a44e59e046c5da416e68d. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:17:56.348669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Getting quotas for user 710470ea975e45cc95d3fc679abb6cbf and project 7d47d9888e1a44e59e046c5da416e68d. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:17:56.380987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:17:56.386275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:17:56.466805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b384e3da-f8ab-492d-b99d-ae88ac09d25d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.675473 Apr 20 19:17:56.467495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 16/29] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:17:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 3677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:17:56.479833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e2f5f9e-8664-4180-b844-a28fc2c20d34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:56.480963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e2f5f9e-8664-4180-b844-a28fc2c20d34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:56.756339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8e2f5f9e-8664-4180-b844-a28fc2c20d34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:56.772894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e2f5f9e-8664-4180-b844-a28fc2c20d34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1221 microversion: 2.1 time: 0.297288 Apr 20 19:17:56.775574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 17/30] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:56 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:57.004673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1044219432", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54a87281-cac4-4c39-a9e0-64b8c916f808"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:17:57.206917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] validate_networks() for [('54a87281-cac4-4c39-a9e0-64b8c916f808', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:17:57.879126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:17:57.895917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a964776d-37d1-498e-a29b-818149c7faa0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 1.636338 Apr 20 19:17:57.909855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 14/31] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:56 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:17:57.915659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:17:57.916325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:17:57.940869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:57.941378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:17:57.942286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:17:57.948129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:00.562589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:00.581885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ce54a5a0-6307-41fc-9a62-b8812c2ed006 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 2.676973 Apr 20 19:18:00.582547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:17:57 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:00.589422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:00.590137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:00.602953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:00.604025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:00.605327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:00.606040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.767827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:01.776826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-97b20e71-f491-451b-9dff-f5b017daf37e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 1.193175 Apr 20 19:18:01.777444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:00 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:01.842070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:01.842956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:01.843505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:01.843962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:01.844422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:01.853662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.854201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.855126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.855794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.856150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-7cac5c47-3d30-4b31-af10-be2c63533cf1 req-b835ff27-49c7-4b5f-b173-c14554d25e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3e0d30-5d56-4781-baab-a9ef97961235", "tag": "61058f3c-8b60-49a4-861f-fd84a5142bbc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:01.858948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:01.858948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:01.875640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Getting quotas for project 7d47d9888e1a44e59e046c5da416e68d. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:01.878984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7cac5c47-3d30-4b31-af10-be2c63533cf1 req-b835ff27-49c7-4b5f-b173-c14554d25e5b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.879619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Getting quotas for user 710470ea975e45cc95d3fc679abb6cbf and project 7d47d9888e1a44e59e046c5da416e68d. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:01.879915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7cac5c47-3d30-4b31-af10-be2c63533cf1 req-b835ff27-49c7-4b5f-b173-c14554d25e5b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.891348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:01.893846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:01.903911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-7cac5c47-3d30-4b31-af10-be2c63533cf1 req-b835ff27-49c7-4b5f-b173-c14554d25e5b service nova] Creating event network-changed:61058f3c-8b60-49a4-861f-fd84a5142bbc for instance 3a3e0d30-5d56-4781-baab-a9ef97961235 on hv-cinder-78693 Apr 20 19:18:01.904892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7cac5c47-3d30-4b31-af10-be2c63533cf1 req-b835ff27-49c7-4b5f-b173-c14554d25e5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=100514) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 19:18:01.906625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.907703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.909608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.910318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.922108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.compute.rpcapi [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 19:18:01.923732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] Releasing lock "compute-rpcapi-router" {{(pid=100514) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 19:18:01.952141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2c9924ac-5236-4c5f-a03a-beddc94887a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.951827 Apr 20 19:18:01.953047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 18/34] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:17:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 4953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:18:01.958352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:01.959010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:01.966896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-326e4e42-037e-44d3-8e8e-d5fe8267186c None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187696 Apr 20 19:18:01.967861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.968289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:01.968687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.969655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:01.970340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:01.974515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-97534772-4ee4-4680-a9fb-d4a6d748d751 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:01.975291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-97534772-4ee4-4680-a9fb-d4a6d748d751 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:02.202223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-97534772-4ee4-4680-a9fb-d4a6d748d751 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:02.211920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-97534772-4ee4-4680-a9fb-d4a6d748d751 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1222 microversion: 2.1 time: 0.241923 Apr 20 19:18:02.212726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:01 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:02.218103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1076119376", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f331ac5d-ad3b-4e48-8bf1-fb572b65b568"}], "security_groups": [{"name": "tempest-securitygroup--1995719750"}], "key_name": "tempest-keypair-645576227", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:02.485352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:02.494363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f6a39e0a-2d16-4e26-9fd9-a186a81c6d76 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 0.540445 Apr 20 19:18:02.494939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:01 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:02.537718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] validate_networks() for [('f331ac5d-ad3b-4e48-8bf1-fb572b65b568', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:02.795101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:02.795744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:02.810996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:02.811802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:02.815066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:02.815752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:03.645539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:03.658546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-704136cc-a78b-4308-9b14-959965fa6ae2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.867453 Apr 20 19:18:03.659492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:02 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:03.747027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-17e9de67-507a-4c59-a020-b29e91879c8d req-0d703dc4-bf14-446d-9fd9-f5a2f4a9a306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092abfd7-6e6a-4c09-91bb-2884e1747d7c", "name": "network-vif-plugged", "status": "completed", "tag": "c97bca53-bcf6-4794-a9d1-87831540373f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:03.748941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:03.748941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:03.758644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-17e9de67-507a-4c59-a020-b29e91879c8d req-0d703dc4-bf14-446d-9fd9-f5a2f4a9a306 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:03.759149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-17e9de67-507a-4c59-a020-b29e91879c8d req-0d703dc4-bf14-446d-9fd9-f5a2f4a9a306 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:03.778954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-17e9de67-507a-4c59-a020-b29e91879c8d req-0d703dc4-bf14-446d-9fd9-f5a2f4a9a306 service nova] Creating event network-vif-plugged:c97bca53-bcf6-4794-a9d1-87831540373f for instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c on hv-cinder-78693 Apr 20 19:18:03.784527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-17e9de67-507a-4c59-a020-b29e91879c8d req-0d703dc4-bf14-446d-9fd9-f5a2f4a9a306 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123875 Apr 20 19:18:03.785472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 21/39] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:03.791265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:03.792019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:03.801425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:03.801968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:03.802861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:03.803832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:03.990513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:04.001555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a62bf608-592d-4ccd-9e01-2bcff56cc0eb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1274 microversion: 2.1 time: 0.214617 Apr 20 19:18:04.002403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:03 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:04.007262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:04.007931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:04.017935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.018816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.019902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.020235 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.315741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:04.316204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:04.316828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:04.317461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:04.317930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:04.328623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.329265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.330445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.331086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.349957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:04.354867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:04.366842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:04.369768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:04.379277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:04.391423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c71a426-31c6-4611-85ca-6d81a5067ae7 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 0.387424 Apr 20 19:18:04.392247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:04 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:04.397657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-4ddee739-2f4e-4952-823d-50b138d69dfe req-575fcd45-ce7a-4c35-92ee-10f11d4e75fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb06c1b0-0d59-4ae0-a487-4fa1252de8e1", "tag": "25a065c9-4997-4b1c-8cf3-f66d5c392d3a"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:04.399980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:04.399980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:04.409644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4ddee739-2f4e-4952-823d-50b138d69dfe req-575fcd45-ce7a-4c35-92ee-10f11d4e75fd service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.410429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4ddee739-2f4e-4952-823d-50b138d69dfe req-575fcd45-ce7a-4c35-92ee-10f11d4e75fd service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.427764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-4ddee739-2f4e-4952-823d-50b138d69dfe req-575fcd45-ce7a-4c35-92ee-10f11d4e75fd service nova] Creating event network-changed:25a065c9-4997-4b1c-8cf3-f66d5c392d3a for instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 on hv-cinder-78693 Apr 20 19:18:04.429108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c805eca-1c2e-4048-a0f2-0cc2f6d8a335 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.215281 Apr 20 19:18:04.429809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 19/42] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:18:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:18:04.439494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-4ddee739-2f4e-4952-823d-50b138d69dfe req-575fcd45-ce7a-4c35-92ee-10f11d4e75fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Apr 20 19:18:04.440161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 24/43] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:04.448353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6408cbf9-4676-47ac-b743-9a9b3f32b2e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:04.449114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6408cbf9-4676-47ac-b743-9a9b3f32b2e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:04.494229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: .version_select at 0x7fd8e0d37a60>, body: {"keypair": {"name": "tempest-keypair-685292182"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:04.519308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:04.523650 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:04.536276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6408cbf9-4676-47ac-b743-9a9b3f32b2e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:04.544691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6408cbf9-4676-47ac-b743-9a9b3f32b2e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1237 microversion: 2.1 time: 0.100980 Apr 20 19:18:04.555535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 25/44] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:04 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:04.677311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:04.678025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:04.686976 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.687489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.688359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:04.688845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:04.777063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:04.781174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:04.795707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a0acafaf-f6fa-4fd4-9710-6206900b0835 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.364579 Apr 20 19:18:04.796538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 20/45] 10.222.0.48 () {62 vars in 1189 bytes} [Tue Apr 20 19:18:04 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 366 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:18:04.965274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:04.975290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2a4b4a40-a407-411c-a46a-ee49a9ef393e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.302798 Apr 20 19:18:04.975929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 26/46] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:04 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:05.019875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:05.020553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:05.029101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.029617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.030511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.031011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.328734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:05.344924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e38d5fbb-cc2c-407d-8c0a-946208b44c7e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1274 microversion: 2.1 time: 0.327195 Apr 20 19:18:05.357697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 21/47] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:05 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:05.409430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:05.410094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:05.426333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.428961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.430625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.431124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.563436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:05.564364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:05.577018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.577536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.580887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:05.581455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:05.924582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:05.934406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-46f84acd-21fb-411c-aa95-366ad2dd8562 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1241 microversion: 2.1 time: 0.375608 Apr 20 19:18:05.940728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:05 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1241 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:06.004265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:06.004973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:06.015875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.016927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:06.017806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.018390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:06.067788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:06.081097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2429efd9-ccaa-4a6d-a129-be9419b97045 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 0.676219 Apr 20 19:18:06.082086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 27/49] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:05 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:06.364779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:06.365883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:06.396057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.398087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:06.399915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.402162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:06.851489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:06.867323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-274a2da8-3039-42f5-95b6-38a1fcf50d49 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1274 microversion: 2.1 time: 0.506415 Apr 20 19:18:06.867882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 28/50] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:06 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1274 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:06.960122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:06.960785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:06.982395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.982908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:06.983752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:06.986550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:07.345926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:07.373050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8bafe3d5-fd39-4ffa-963c-969695e11a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1289 microversion: 2.1 time: 0.418196 Apr 20 19:18:07.374003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 29/51] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:06 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1289 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:07.393980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:07.395240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:07.421372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:07.422256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:07.423467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:07.426422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:07.632683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:07.654336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b437104d-0de0-4b1a-a45b-6ebfc44b487a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 1.658760 Apr 20 19:18:07.655267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 23/52] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:05 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:07.890709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:07.890709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:07.904711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:07.905271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:07.906138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:07.906628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:08.303734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:08.318231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-929b6408-5808-4699-a5a1-4a877dc06acd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1280 microversion: 2.1 time: 0.437270 Apr 20 19:18:08.329492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:07 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1280 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:08.396901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:08.398771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:08.409143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:08.409749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:08.410724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:08.411360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:08.670185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:08.680112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df0949ca-e409-4258-aa6a-c0c151d344a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1295 microversion: 2.1 time: 0.291675 Apr 20 19:18:08.680716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:08 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1295 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:08.686012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:08.686839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:08.696907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:08.697602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:08.698744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:08.699383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:09.013772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:09.022626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dee78d1a-b3ab-4781-99db-c6e2e978fb45 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1314 microversion: 2.1 time: 1.646938 Apr 20 19:18:09.023496 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 30/55] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:07 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1314 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:09.337988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:09.337988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:09.349651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:09.350160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:09.356552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:09.360094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:10.173098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:10.182889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f261a90f-6987-4c3d-a6bc-c8cbb821170f tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 1.500916 Apr 20 19:18:10.183816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 26/56] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:08 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:10.189258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:10.190284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:10.198949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:10.199713 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:10.200972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:10.201655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:10.683442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:10.693471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e35c9b2e-2747-4111-924a-4b5c2de30ca8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 1.360587 Apr 20 19:18:10.694520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:09 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:10.710230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:10.711234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:10.719784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:10.720295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:10.721156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:10.721637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:10.897905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:10.906979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-172928eb-e602-411f-822d-7c7778fc4334 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.721585 Apr 20 19:18:10.907625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 27/58] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:10 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:11.178391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:11.191393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0ab413f2-bf9b-4a52-8218-4fa5a79ecf00 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1501 microversion: 2.1 time: 0.485525 Apr 20 19:18:11.192116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 32/59] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:10 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1501 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:11.211049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:11.212073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:11.222046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:11.222719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:11.223762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:11.224439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:11.403151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-97501394", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b51c7665-608e-4722-a739-79996e632bcb"}], "security_groups": [{"name": "tempest-securitygroup--223656636"}], "key_name": "tempest-keypair-685292182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:11.609287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] validate_networks() for [('b51c7665-608e-4722-a739-79996e632bcb', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:11.614572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:11.636346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e7cc72ad-fbeb-4ba5-b870-d04ff4d23160 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.428959 Apr 20 19:18:11.637321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 28/60] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:11 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:11.712094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:11.713143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:11.726494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:11.727014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:11.727880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:11.728386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:12.230632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:12.291027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-79c654f8-3676-4430-97ce-613026ce8b08 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.557869 Apr 20 19:18:12.292224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 29/61] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:11 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:12.297291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:12.301018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:12.309259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:12.310096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:12.311258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:12.312079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.006136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:13.011477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:13.011945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:13.012481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:13.012932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:13.013363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:13.020630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-243f17b8-4d7f-4a63-aaf5-c4ae18dba659 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.726709 Apr 20 19:18:13.021651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 30/62] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:12 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:13.024954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.025451 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.026346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.026837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.034118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-d6c7080f-f3a9-4d5e-b4c7-5ef69129e11c req-bb77344e-7ee7-4303-a00a-cfefd80c5296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed22536-36ea-4a58-9a50-f724b719ad55", "tag": "f1a70b57-4809-468b-bc54-39462d51aaa1"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:13.036440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:13.036440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:13.048165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:13.051332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d6c7080f-f3a9-4d5e-b4c7-5ef69129e11c req-bb77344e-7ee7-4303-a00a-cfefd80c5296 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.055043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d6c7080f-f3a9-4d5e-b4c7-5ef69129e11c req-bb77344e-7ee7-4303-a00a-cfefd80c5296 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.066845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:13.086556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-d6c7080f-f3a9-4d5e-b4c7-5ef69129e11c req-bb77344e-7ee7-4303-a00a-cfefd80c5296 service nova] Creating event network-changed:f1a70b57-4809-468b-bc54-39462d51aaa1 for instance eed22536-36ea-4a58-9a50-f724b719ad55 on hv-cinder-78693 Apr 20 19:18:13.092843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-d6c7080f-f3a9-4d5e-b4c7-5ef69129e11c req-bb77344e-7ee7-4303-a00a-cfefd80c5296 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069605 Apr 20 19:18:13.095436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 31/63] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:13.104888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:13.106058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:13.118389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.119234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.121255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.122098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.124222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:13.129807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:13.394443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3af02b47-7987-4cbb-9199-0bfcef9e4fd8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.997365 Apr 20 19:18:13.397151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 33/64] 10.222.0.48 () {62 vars in 1178 bytes} [Tue Apr 20 19:18:11 2021] POST /compute/v2.1/servers => generated 401 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 19:18:13.404767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc652dd0-bed1-4b68-8343-6e009b19d180"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:13.407277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:13.436300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.436912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.437787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.438301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.513930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:13.533196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e613577d-99ad-4939-9c54-81f7bcfdc4e6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.435915 Apr 20 19:18:13.533817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:13 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:13.548824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:13.549492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:13.560236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.560739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:13.561580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:13.562093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:14.022519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.034050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7e9fa6fb-1d3e-4454-ae11-0cbeb45633ec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.497408 Apr 20 19:18:14.034708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:13 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:14.041044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:14.042553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:14.143168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.154657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.156663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.158064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5f942b87-1024-4289-b09e-49e6d2e0f0b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1279 microversion: 2.20 time: 0.122341 Apr 20 19:18:14.158871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:14 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:14.175006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:14.175867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:14.185138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:14.186005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:14.186917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:14.187474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:14.257481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-74b9699c-2ad3-4418-a4a4-c6a81481f138 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "POST /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858705 Apr 20 19:18:14.258458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:18:13 2021] POST /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:14.553637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.562573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:14.563792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:14.581431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-37411299-435d-4a7c-9376-0ce43b17c7c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.421227 Apr 20 19:18:14.597440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:14 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:14.599791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:14.600489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:14.601664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:14.602346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:14.910947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:14.922957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f7921575-0d23-4fd2-85ee-f6a0b91d1f11 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.373909 Apr 20 19:18:14.923846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:14 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:15.053547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:15.054563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:15.067323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.068233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.069718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.073511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.178260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:15.179051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:15.188041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.188854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.189915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.190544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.420348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:15.430512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:15.432163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:15.437986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fa39633d-79a1-4481-b09b-0102779e6130 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1339 microversion: 2.20 time: 0.264296 Apr 20 19:18:15.441869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 36/71] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:15 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:15.456764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-12707502-fbbb-45a9-9fc7-3f3fab48fce7 req-19ac221a-7230-4431-9b60-426f06417525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072ef72c-8b70-4646-b698-a199605e7183", "tag": "fd534917-0276-4ed8-88b8-906951ef7306"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:15.466686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:15.466686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:15.486064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-12707502-fbbb-45a9-9fc7-3f3fab48fce7 req-19ac221a-7230-4431-9b60-426f06417525 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.486873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-12707502-fbbb-45a9-9fc7-3f3fab48fce7 req-19ac221a-7230-4431-9b60-426f06417525 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.518513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-12707502-fbbb-45a9-9fc7-3f3fab48fce7 req-19ac221a-7230-4431-9b60-426f06417525 service nova] Creating event network-changed:fd534917-0276-4ed8-88b8-906951ef7306 for instance 072ef72c-8b70-4646-b698-a199605e7183 on hv-cinder-78693 Apr 20 19:18:15.540047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-12707502-fbbb-45a9-9fc7-3f3fab48fce7 req-19ac221a-7230-4431-9b60-426f06417525 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096310 Apr 20 19:18:15.540922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 37/72] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:15.604025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:15.604881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:15.616262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.619407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.622187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.628218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.717813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:15.732637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a633b1c2-e5cc-47b3-a0f0-2bf48a116d1c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.684573 Apr 20 19:18:15.733536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 36/73] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:15 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:15.895561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:15.904726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4765d623-384e-4f32-b7c6-ff59714a2e88 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.305266 Apr 20 19:18:15.905782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 38/74] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:15 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:15.941264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:15.941970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:15.951322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.951782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:15.952633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:15.953173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.206115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:16.215577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d3ea03fa-a003-4983-bf2a-107482c0fc3d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.278755 Apr 20 19:18:16.216583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 37/75] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:15 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:16.460876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:16.461543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:16.472641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.473340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.474418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.474917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.600581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:16.610815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:16.613247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:16.615032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-61de8932-ac9e-41b9-9302-d6b2a95549f3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1337 microversion: 2.20 time: 0.158471 Apr 20 19:18:16.622743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:16 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1337 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:16.750951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:16.751825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:16.760123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.760865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.761776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.762476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.922928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:16.923724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:16.932216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.932532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:16.933349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:16.933907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:17.011330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.021503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4fc8e399-381f-4095-b3c0-6965baed6be6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.274510 Apr 20 19:18:17.022411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:16 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:17.190488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.193961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-64a7aa6c-9ca6-46a3-8b36-3a49f9522dc3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.274910 Apr 20 19:18:17.194755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:16 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:17.233013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:17.233969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:17.242498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:17.243129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:17.244082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:17.244648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:17.472893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.482480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a21b3ddb-1af8-4651-97e2-a91fea923551 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.253613 Apr 20 19:18:17.493261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:17 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:17.634782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:17.635446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:17.643259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:17.644157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:17.645198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:17.645919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:17.777295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.789044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.791004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:17.792325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d16bbf4c-953f-4023-a048-016039fecd6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1337 microversion: 2.20 time: 0.161669 Apr 20 19:18:17.793067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 41/80] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:17 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1337 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:18.039972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:18.040650 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:18.048643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.049142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.050083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.050563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.212323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:18.212922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:18.222974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.223481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.224341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.224883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.271296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:18.288530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1b232917-155d-4467-bc6a-fd0d20ab28f6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.252612 Apr 20 19:18:18.289911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:18 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:18.440757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:18.449877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-02c048da-9945-4dd8-9061-f0bde49d0cbe tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.241598 Apr 20 19:18:18.450501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:18 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:18.508011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:18.509760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:18.524713 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.525415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.526816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.527509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.812929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:18.814802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:18.832466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.835039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:18.837278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:18.839404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:19.349500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:19.365737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:19.367664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:19.372737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-24f855db-d4a4-419d-97e2-d3b00ade0d23 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1337 microversion: 2.20 time: 0.565129 Apr 20 19:18:19.373573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 43/83] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:18 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1337 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:19.389095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-0db0cd46-a6dc-466a-94c4-734383d1d3e7 req-43f18203-b546-4385-9cc3-f5a5637f295f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3e0d30-5d56-4781-baab-a9ef97961235", "name": "network-vif-plugged", "status": "completed", "tag": "61058f3c-8b60-49a4-861f-fd84a5142bbc"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:19.391633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:19.391633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:19.412670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0db0cd46-a6dc-466a-94c4-734383d1d3e7 req-43f18203-b546-4385-9cc3-f5a5637f295f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:19.413356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:19.414098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0db0cd46-a6dc-466a-94c4-734383d1d3e7 req-43f18203-b546-4385-9cc3-f5a5637f295f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:19.428056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c06c9009-f5a0-4dcd-b49c-4e8a3462af7a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.931090 Apr 20 19:18:19.429442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:18 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:19.445673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:19.446595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:19.456520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:19.457683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:19.457995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-0db0cd46-a6dc-466a-94c4-734383d1d3e7 req-43f18203-b546-4385-9cc3-f5a5637f295f service nova] Creating event network-vif-plugged:61058f3c-8b60-49a4-861f-fd84a5142bbc for instance 3a3e0d30-5d56-4781-baab-a9ef97961235 on hv-cinder-78693 Apr 20 19:18:19.458952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:19.459624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:19.465216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-0db0cd46-a6dc-466a-94c4-734383d1d3e7 req-43f18203-b546-4385-9cc3-f5a5637f295f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089325 Apr 20 19:18:19.472622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 44/85] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:19.478494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:19.482739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:19.500544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:19.503789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:19.504719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:19.506394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:20.253184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:20.270508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e796e211-4a3c-4490-bf24-9c08e7948bc5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.829225 Apr 20 19:18:20.271422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 42/86] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:19 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:20.288176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:20.298604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e3e39fd1-d4a4-4f0d-a28c-d2b1512ce567 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.824515 Apr 20 19:18:20.306721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 45/87] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:19 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:20.401954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:20.402835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:20.425492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:20.426355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:20.427400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:20.428054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:20.446544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:20.447537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:20.474012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:20.474707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:20.475810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:20.476305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:21.209560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:21.230568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ef7d6d5c-9466-4d7b-8dab-a6fd6a56f8a2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1318 microversion: 2.1 time: 0.788003 Apr 20 19:18:21.231392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 46/88] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:20 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:21.289285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:21.290472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:21.314162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:21.314866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:21.318728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:21.319385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:21.462299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:21.479258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:21.480898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:21.489308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ad1a22ea-c0eb-418d-bce2-7a97f88aeb14 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 1.101343 Apr 20 19:18:21.493473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 43/89] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:20 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:21.515894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:21.516734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:21.525676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:21.526436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:21.527620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:21.528228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.289389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:22.294222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:22.302742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-658ffb5f-a908-4353-9e1b-241e82d168b9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.805821 Apr 20 19:18:22.303902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:21 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:22.309234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb06c1b0-0d59-4ae0-a487-4fa1252de8e1", "name": "network-vif-plugged", "status": "completed", "tag": "25a065c9-4997-4b1c-8cf3-f66d5c392d3a"}, {"server_uuid": "eed22536-36ea-4a58-9a50-f724b719ad55", "name": "network-vif-plugged", "status": "completed", "tag": "f1a70b57-4809-468b-bc54-39462d51aaa1"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:22.311348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-10e703fb-263d-4f8b-b26f-8cd2b277be4d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 1.026391 Apr 20 19:18:22.311786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:22.311786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:22.312206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 47/91] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:21 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:22.316949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:22.317617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:22.324594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.325529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.328826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.329336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.330218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.330710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.367100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] Creating event network-vif-plugged:25a065c9-4997-4b1c-8cf3-f66d5c392d3a for instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 on hv-cinder-78693 Apr 20 19:18:22.367675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] Creating event network-vif-plugged:f1a70b57-4809-468b-bc54-39462d51aaa1 for instance eed22536-36ea-4a58-9a50-f724b719ad55 on hv-cinder-78693 Apr 20 19:18:22.377651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-90de3a55-02a4-4666-84c8-b761980ca0f8 req-62bfe758-393a-42d4-bf60-fd4b45e7666a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072023 Apr 20 19:18:22.378364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 45/92] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:22.486177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-fca84433-5f4d-4f01-9abf-551bf04f563d req-afba2654-ca31-417a-b077-e3d177a3a867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:22.492888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:22.492888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:22.540764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fca84433-5f4d-4f01-9abf-551bf04f563d req-afba2654-ca31-417a-b077-e3d177a3a867 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.541315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fca84433-5f4d-4f01-9abf-551bf04f563d req-afba2654-ca31-417a-b077-e3d177a3a867 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.582946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-fca84433-5f4d-4f01-9abf-551bf04f563d req-afba2654-ca31-417a-b077-e3d177a3a867 service nova] Creating event network-changed:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:18:22.596670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-fca84433-5f4d-4f01-9abf-551bf04f563d req-afba2654-ca31-417a-b077-e3d177a3a867 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117469 Apr 20 19:18:22.599790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 46/93] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:22.615759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:22.624723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:22.644621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.646709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:22.649186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:22.651828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.134353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:23.147724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-92850fce-70fd-4d59-a80b-5e043a026bd5 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1508 microversion: 2.1 time: 0.834328 Apr 20 19:18:23.148764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 48/94] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:22 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:23.155445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:23.156645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:23.166487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.167296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.168309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.169069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.322208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:18:23.348705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:23.360949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:23.362587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:23.369395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f12d6bba-abdd-4056-84a8-310f4482a60a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 0.762612 Apr 20 19:18:23.370762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 47/95] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:22 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:23.384106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:23.384791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:23.405762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.406304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.407172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.407667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.609684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-02363d95-2095-46fb-bb47-ee657bccb254 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "DELETE /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 204 len: 0 microversion: 2.1 time: 0.459263 Apr 20 19:18:23.610677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 49/96] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:18:23 2021] DELETE /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:18:23.641390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:23.642480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:23.659935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.673986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:23.675646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:23.676553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.208101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:24.221993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7ddf985e-e4ae-4c2a-8c8d-6b5c4d8cc262 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.850719 Apr 20 19:18:24.223111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 48/97] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:23 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:24.237643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:24.238369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:24.264301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:24.264866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.269231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:24.269744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.558346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:24.571056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-45cc8804-8400-4a89-bd57-1e7e87185931 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1322 microversion: 2.1 time: 0.958886 Apr 20 19:18:24.582712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 50/98] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:23 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1322 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:24.588523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:24.589335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:24.599292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:24.600076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.601228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:24.601931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.829242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:24.840970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1d8c48a5-2be2-4987-b4b3-4795ff601194 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1553 microversion: 2.1 time: 0.616517 Apr 20 19:18:24.841766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:24 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1553 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:24.857173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-bac340d3-68af-44f9-96e1-7abc758df784 req-44b4d015-fbe0-4bf4-8195-e43d10a1b6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ef72c-8b70-4646-b698-a199605e7183", "name": "network-vif-plugged", "status": "completed", "tag": "fd534917-0276-4ed8-88b8-906951ef7306"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:24.858985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:24.858985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:24.868444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bac340d3-68af-44f9-96e1-7abc758df784 req-44b4d015-fbe0-4bf4-8195-e43d10a1b6b4 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:24.868954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bac340d3-68af-44f9-96e1-7abc758df784 req-44b4d015-fbe0-4bf4-8195-e43d10a1b6b4 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:24.888573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-bac340d3-68af-44f9-96e1-7abc758df784 req-44b4d015-fbe0-4bf4-8195-e43d10a1b6b4 service nova] Creating event network-vif-plugged:fd534917-0276-4ed8-88b8-906951ef7306 for instance 072ef72c-8b70-4646-b698-a199605e7183 on hv-cinder-78693 Apr 20 19:18:24.895384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-bac340d3-68af-44f9-96e1-7abc758df784 req-44b4d015-fbe0-4bf4-8195-e43d10a1b6b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047794 Apr 20 19:18:24.896200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 50/100] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:25.246726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:25.247637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:25.266938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.269104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:25.273804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.274717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:25.563886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:25.577594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:25.579138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:25.580455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6eb21908-c57c-4001-aeb9-a61c792ffe2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 0.996643 Apr 20 19:18:25.581677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 51/101] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:24 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:25.586863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52cb923a-a068-4514-a410-d931ad5938ac"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:25.588862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:25.599586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.600433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:25.601433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.602498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:25.767460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:25.782239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9a92d702-963c-493f-9cfb-912d16e23bb3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1363 microversion: 2.1 time: 0.543332 Apr 20 19:18:25.784322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 51/102] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:25 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:25.789634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:25.790296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:25.812427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.812922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:25.813860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:25.814413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.169498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ff4bb39e-aa6a-42c9-ae83-fbc8e80eee2e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586263 Apr 20 19:18:26.170739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 52/103] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:18:25 2021] POST /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:26.179702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:26.184887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:26.217807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.221014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.223535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.224868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.640021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:26.651144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-60f0cc25-32b2-4a4b-96b5-ab960af2d242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1516 microversion: 2.1 time: 0.865508 Apr 20 19:18:26.654988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 52/104] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:25 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1516 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:26.682708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:26.685650 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:26.702592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.706523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.709008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.709666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.851968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:26.866670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fec8fa89-9cb6-493e-93e2-151dc25bdbcf tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1553 microversion: 2.1 time: 0.694177 Apr 20 19:18:26.867794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:26 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1553 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:26.890624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:26.892443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:26.905802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.906737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.907845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:26.908545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:26.983063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'flavor' on Instance uuid eed22536-36ea-4a58-9a50-f724b719ad55 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:18:27.049904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:27.085298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:27.113405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:27.115033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a49fb3b2-9f8e-4d8e-b09f-60ff1ce4cc31 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 0.443389 Apr 20 19:18:27.120935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 53/106] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:26 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:27.135051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:27.136027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:27.146709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.147725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.148931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.149748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.189689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2790a273-dde5-43ce-80f7-2b55a1565b51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55/action" status: 200 len: 32 microversion: 2.1 time: 0.320386 Apr 20 19:18:27.190898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 54/107] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:26 2021] POST /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:27.202758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:27.204486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:27.215449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.216876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.218358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.219214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.811579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:27.825112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06f95e62-8b22-4396-a942-3ff0a051fbdc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.628483 Apr 20 19:18:27.825773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:27 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:27.872403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:27.882458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a29abe6d-ba7f-4ec5-a07a-78235e7ba8b3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1549 microversion: 2.1 time: 0.758127 Apr 20 19:18:27.890321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:27.891550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:27.900771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 54/109] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:27 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1549 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:27.907165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:27.907316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.907711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:27.907853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.908558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.911859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.927725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.928208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:27.929219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:27.929898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:28.441912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c3a82147-b639-4924-addf-132ac2c92e3e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.539276 Apr 20 19:18:28.442815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1265 bytes} [Tue Apr 20 19:18:27 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-interface => generated 284 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:18:28.448655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:28.449527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:28.462270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:28.462851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:28.463766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:28.464339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:29.572322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a16061c24ab9474d8c85faaa9586883c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf6133fbc814cb1881e1239159e0568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:29.591616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e794895a-7a31-41ea-a899-6d41c994b2ea tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 200 len: 1553 microversion: 2.1 time: 1.706684 Apr 20 19:18:29.592840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 56/111] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:27 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 1553 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:29.598079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-13d5acf2-922c-4181-b28c-5b61cc3aae1e req-d8a3201b-1988-4385-a584-75086202b509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092abfd7-6e6a-4c09-91bb-2884e1747d7c", "name": "network-vif-deleted", "tag": "c97bca53-bcf6-4794-a9d1-87831540373f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:29.612170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:29.612170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:29.626206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-13d5acf2-922c-4181-b28c-5b61cc3aae1e req-d8a3201b-1988-4385-a584-75086202b509 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:29.626715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-13d5acf2-922c-4181-b28c-5b61cc3aae1e req-d8a3201b-1988-4385-a584-75086202b509 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:29.671835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-13d5acf2-922c-4181-b28c-5b61cc3aae1e req-d8a3201b-1988-4385-a584-75086202b509 service nova] Creating event network-vif-deleted:c97bca53-bcf6-4794-a9d1-87831540373f for instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c on hv-cinder-78693 Apr 20 19:18:29.680061 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-13d5acf2-922c-4181-b28c-5b61cc3aae1e req-d8a3201b-1988-4385-a584-75086202b509 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085637 Apr 20 19:18:29.681039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 57/112] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:29.691796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:29.692777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:29.706395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:29.707413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:29.708464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:29.709149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:30.166618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:30.183533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:30.185551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:30.187733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a9ea339c-647d-41e5-918f-f39f11c73c6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 1.743067 Apr 20 19:18:30.188524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 56/113] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:28 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:30.194874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-b6f0cdcc-4ae1-4541-b52a-db1228490c03 req-3aa16541-b443-4368-9706-4a4abd960304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "name": "network-vif-plugged", "status": "completed", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:30.197547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:30.197547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:30.210139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b6f0cdcc-4ae1-4541-b52a-db1228490c03 req-3aa16541-b443-4368-9706-4a4abd960304 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:30.210895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b6f0cdcc-4ae1-4541-b52a-db1228490c03 req-3aa16541-b443-4368-9706-4a4abd960304 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:30.250263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-b6f0cdcc-4ae1-4541-b52a-db1228490c03 req-3aa16541-b443-4368-9706-4a4abd960304 service nova] Creating event network-vif-plugged:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:18:30.262530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-b6f0cdcc-4ae1-4541-b52a-db1228490c03 req-3aa16541-b443-4368-9706-4a4abd960304 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070536 Apr 20 19:18:30.263480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 57/114] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:30.612938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:30.614936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:30.624437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:30.625094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:30.626055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:30.626751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:30.682926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] HTTP exception thrown: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. Apr 20 19:18:30.683681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Returning 404 to user: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:18:30.684647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-26475cfa-109c-4f61-b1bf-686bda543221 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 404 len: 111 microversion: 2.1 time: 0.076545 Apr 20 19:18:30.685312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 58/115] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:30 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:18:30.748102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:30.759979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fa0e79f4-b1b4-4dc7-b0b9-2894a717211d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 1.073808 Apr 20 19:18:30.760849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:29 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:31.207992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:31.208825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:31.219524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:31.221244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:31.222962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:31.224138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:31.708860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-653120310", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "530fe84c-bb97-495f-92fc-7c17dfae2367"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:31.791331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] validate_networks() for [('530fe84c-bb97-495f-92fc-7c17dfae2367', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:32.591038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:32.605618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:32.612728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:32.613981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-75854576-0b1e-405f-8d8e-681644689b93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1404 microversion: 2.20 time: 1.410938 Apr 20 19:18:32.614611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 59/117] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:31 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1404 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:32.624026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:32.629208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:32.646096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:32.646980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:32.653536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:32.654436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:32.843506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:32.844188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:32.844721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:32.845377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:32.846056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:32.864331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:32.865041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:32.868334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:32.868872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:32.912913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Getting quotas for project 3c847e04a33b45a68c63a63c3ff855fd. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:32.920968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Getting quotas for user 474d34cc538f4d809474e0571b0db346 and project 3c847e04a33b45a68c63a63c3ff855fd. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:32.946844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:32.952026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:33.027137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:33.039083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f7d91625-a720-48c7-9b67-fd853f6936ed tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.419970 Apr 20 19:18:33.039800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:32 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:33.049453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8c040630-e2df-481f-b928-2e4343fae825 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345558 Apr 20 19:18:33.056720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 59/119] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:18:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:18:33.062707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:33.064066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:33.069407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:33.074388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.075116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.076120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.077314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.085293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:33.112005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.112511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.113347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.113917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.253948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] HTTP exception thrown: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. Apr 20 19:18:33.258385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Returning 404 to user: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:18:33.258509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3c0b4194-a280-4fa1-90a1-2dc56417fd5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.199603 Apr 20 19:18:33.259238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 60/120] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:33 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:33.259766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fc257d95-0ac4-41a6-be93-95c274fa9484 tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "DELETE /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 404 len: 111 microversion: 2.1 time: 0.218464 Apr 20 19:18:33.260438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:18:33 2021] DELETE /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:18:33.266882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-38c93b50-53af-4f5e-88fd-d0014eabf8b2 req-7122ed16-90b8-4a90-b8e2-87a9ae227a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072ef72c-8b70-4646-b698-a199605e7183", "tag": "fd534917-0276-4ed8-88b8-906951ef7306"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:33.268516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:33.268516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:33.270703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ad0f0be-5be2-4b70-8bd5-60dc0e95a0c4 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:33.280796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ad0f0be-5be2-4b70-8bd5-60dc0e95a0c4 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:33.291490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-38c93b50-53af-4f5e-88fd-d0014eabf8b2 req-7122ed16-90b8-4a90-b8e2-87a9ae227a6c service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.292168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-38c93b50-53af-4f5e-88fd-d0014eabf8b2 req-7122ed16-90b8-4a90-b8e2-87a9ae227a6c service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.357049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-38c93b50-53af-4f5e-88fd-d0014eabf8b2 req-7122ed16-90b8-4a90-b8e2-87a9ae227a6c service nova] Creating event network-changed:fd534917-0276-4ed8-88b8-906951ef7306 for instance 072ef72c-8b70-4646-b698-a199605e7183 on hv-cinder-78693 Apr 20 19:18:33.367368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-38c93b50-53af-4f5e-88fd-d0014eabf8b2 req-7122ed16-90b8-4a90-b8e2-87a9ae227a6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106586 Apr 20 19:18:33.368028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 61/122] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:33.378003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:33.380394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] [instance: 092abfd7-6e6a-4c09-91bb-2884e1747d7c] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:33.397583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.399595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.404554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.405730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.468698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] HTTP exception thrown: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. Apr 20 19:18:33.469595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] Returning 404 to user: Instance 092abfd7-6e6a-4c09-91bb-2884e1747d7c could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:18:33.470728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ee7f38d-d51c-435d-ac87-5d0d1f9fd72f tempest-DeleteServersTestJSON-280342482 tempest-DeleteServersTestJSON-280342482-project] 10.222.0.48 "GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c" status: 404 len: 111 microversion: 2.1 time: 0.100735 Apr 20 19:18:33.474828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5ad0f0be-5be2-4b70-8bd5-60dc0e95a0c4 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:33.480192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 62/123] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:33 2021] GET /compute/v2.1/servers/092abfd7-6e6a-4c09-91bb-2884e1747d7c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:18:33.488179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ad0f0be-5be2-4b70-8bd5-60dc0e95a0c4 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1213 microversion: 2.1 time: 0.226624 Apr 20 19:18:33.489531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 62/124] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:33 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:33.620932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-501906320", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "a3d56b3d-c47b-49ff-9e13-42db36c3dbd5"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:33.635577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:33.636400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:33.659249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.660744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.666874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:33.668175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:33.838171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] validate_networks() for [('a3d56b3d-c47b-49ff-9e13-42db36c3dbd5', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:34.625041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:34.643572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:34.645388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:34.646700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a6d5c91e-f002-4df5-8d79-2a04072bfcaf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1597 microversion: 2.20 time: 1.016479 Apr 20 19:18:34.647322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 63/125] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:18:33 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1597 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:34.671122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:34.672174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:34.699777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:34.700284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:34.701142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:34.701636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.302710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:35.313638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-26e882cd-9e2a-4342-b3b9-765db3793a86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.665164 Apr 20 19:18:35.314313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 64/126] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:34 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:35.328435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:35.330342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:35.341985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.342712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.344116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.344824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.511891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f0764923-1d4a-46d7-837e-ba9e3c2f26b6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.195545 Apr 20 19:18:35.512612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 65/127] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:35 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:35.522059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:35.523057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:35.558787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.559270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.563855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.565289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.632696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:35.633925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:35.634712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:35.635471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:35.636075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:35.651986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.652669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.654741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.657915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.699082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:35.707820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for user 825e0fb1ce1741fd9735f09cd3da24b2 and project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:35.743271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:35.746243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:35.802769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5f5ddc1-bda7-4e3a-ab2b-25e08d155cc6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186371 Apr 20 19:18:35.804016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 63/128] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:18:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:18:35.832881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:35.833643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:35.843614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.844618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:35.845955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:35.846635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.323595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1ba3a75d-9852-40a7-b6dc-d544632ae720 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.511307 Apr 20 19:18:36.331111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 64/129] 10.222.0.48 () {60 vars in 1306 bytes} [Tue Apr 20 19:18:35 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-interface => generated 285 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:36.337667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:36.338368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:36.347286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.348028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.349016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.349697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.526116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:36.536263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-69e487ae-69a9-41f3-a6c7-2d29d7c390a4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1221 microversion: 2.1 time: 0.203613 Apr 20 19:18:36.538318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 65/130] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:36 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:36.552582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:36.553730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:36.562796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.567079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:36.569964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.571096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.571606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.579366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-726d62da-0c73-445b-8232-26920039383a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 1.063125 Apr 20 19:18:36.580262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 66/131] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:35 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:36.585622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:36.587137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:36.596380 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.597262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.598619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:36.599333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:36.748710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f80f02e0-b5fb-4116-bdd9-852c68c45ba2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.166280 Apr 20 19:18:36.749668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 67/132] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:36 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:37.555076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:37.555779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:37.564287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.565048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.566075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.567075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.584995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:37.600726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cfdc4b06-bb31-44a3-b30d-118945d2e6e0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 1.059910 Apr 20 19:18:37.609628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:36 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:37.615707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:37.616945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:37.628699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.630200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.633217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.634204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.806517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:37.822436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3cbfafe2-5b07-49cc-8df9-6880b3d56d51 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1275 microversion: 2.1 time: 0.271808 Apr 20 19:18:37.824180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 68/134] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:37 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:37.830527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:37.831596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:37.840512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.841000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.842059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:37.842692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:37.972865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3e459c54-b222-447f-b078-1d828f1dcae3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.145938 Apr 20 19:18:37.974002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 69/135] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:37 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:38.046325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:38.057630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ca723742-83a2-4d17-9e48-42cadab52a4f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.445936 Apr 20 19:18:38.058939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 67/136] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:37 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:38.628607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:38.629452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:38.647551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:38.648054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:38.648922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:38.649417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:38.842130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:38.843507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:38.862386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:38.863917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:38.867199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:38.868308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.597712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:39.608469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b4597c06-7ec3-4bfc-ac2f-71d5f3e60240 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.984608 Apr 20 19:18:39.618901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 70/137] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:38 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:39.624651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:39.626043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:39.641596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:39.642141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.642992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:39.643488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.799882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-961fdb21-b03f-4ca9-9003-083daa4c6ab5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.179319 Apr 20 19:18:39.800767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 71/138] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:39 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:39.807540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:39.809378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:39.830445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:39.831309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.833475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:39.835507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.876960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:39.892547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1f425781-3cc5-470c-be87-6c60535224a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 1.051764 Apr 20 19:18:39.895461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:38 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:39.908579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-bfb40810-58e1-40c2-9680-9016c99b1314 req-c003e6e9-a99f-4dd6-a552-0d8a76c0c140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0", "tag": "7f8c033e-f0d1-45b1-a81b-fb977bf8b465"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:39.915226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:39.915226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:39.935106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bfb40810-58e1-40c2-9680-9016c99b1314 req-c003e6e9-a99f-4dd6-a552-0d8a76c0c140 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:39.941515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bfb40810-58e1-40c2-9680-9016c99b1314 req-c003e6e9-a99f-4dd6-a552-0d8a76c0c140 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:39.981024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-bfb40810-58e1-40c2-9680-9016c99b1314 req-c003e6e9-a99f-4dd6-a552-0d8a76c0c140 service nova] Creating event network-changed:7f8c033e-f0d1-45b1-a81b-fb977bf8b465 for instance c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 on hv-cinder-78693 Apr 20 19:18:39.997067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-bfb40810-58e1-40c2-9680-9016c99b1314 req-c003e6e9-a99f-4dd6-a552-0d8a76c0c140 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099900 Apr 20 19:18:39.997711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 69/140] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:40.012296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:40.016403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:40.034173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.035191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.036409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.037193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.198660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0abcc863-59d8-4544-953d-3bf8db84bd06 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.199263 Apr 20 19:18:40.199748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 70/141] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:39 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:40.558266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:40.588624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-66b0e796-7db2-4564-b058-4365cc42f223 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.786167 Apr 20 19:18:40.589381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 72/142] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:39 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:40.637137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:40.637814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:40.660405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.661355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.662460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.663310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.812696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:40.813751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:40.831664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.832494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.833350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:40.834429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:40.985893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b2b84502-1465-4c54-8d42-8b31c4fc889f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 14 microversion: 2.1 time: 0.178230 Apr 20 19:18:40.987063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 73/143] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:40 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:18:40.993255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:40.994252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:41.003981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.005126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.006598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.007475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.121268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:41.135375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5be08771-519c-4cd8-8818-146829c067db tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.503025 Apr 20 19:18:41.136039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 71/144] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:40 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:41.210875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:41.212031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:41.220557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.221089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.221971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.222631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.396543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:41.407513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ae6f6958-166e-45c8-9b5a-0027b76bffc4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.418777 Apr 20 19:18:41.408507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 74/145] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:40 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:41.409775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-902233b6-2b90-4210-9b0a-f10a50a7963b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.202287 Apr 20 19:18:41.410708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 72/146] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:41 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:41.413490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-e9fabea7-b3f5-4a17-acd0-2e4f1e01e65d req-65479ef6-59ac-4d83-a380-9ba94742f151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358d3991-d8f0-4906-b8b5-33be33d27480", "tag": "cdfa5087-dd7b-4e2e-bec8-adc661ef0728"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:41.415982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:41.415982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:41.426681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-e9fabea7-b3f5-4a17-acd0-2e4f1e01e65d req-65479ef6-59ac-4d83-a380-9ba94742f151 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.427183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-e9fabea7-b3f5-4a17-acd0-2e4f1e01e65d req-65479ef6-59ac-4d83-a380-9ba94742f151 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.448225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-e9fabea7-b3f5-4a17-acd0-2e4f1e01e65d req-65479ef6-59ac-4d83-a380-9ba94742f151 service nova] Creating event network-changed:cdfa5087-dd7b-4e2e-bec8-adc661ef0728 for instance 358d3991-d8f0-4906-b8b5-33be33d27480 on hv-cinder-78693 Apr 20 19:18:41.454224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-e9fabea7-b3f5-4a17-acd0-2e4f1e01e65d req-65479ef6-59ac-4d83-a380-9ba94742f151 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044135 Apr 20 19:18:41.459754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 75/147] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:41.607652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:41.608651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:41.618130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.618797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.619918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:41.620537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:41.993097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-302d98cf-cd08-482b-a4bb-25dc9677de06 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e0d190d0>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:42.103400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-302d98cf-cd08-482b-a4bb-25dc9677de06 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bc8cedf1-c47e-4fe6-816f-0129eec9e5cf" status: 200 len: 350 microversion: 2.1 time: 0.115696 Apr 20 19:18:42.111742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 76/148] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:18:41 2021] GET /compute/v2.1/os-volumes/bc8cedf1-c47e-4fe6-816f-0129eec9e5cf => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:42.117125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:42.121223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:42.143584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.144096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.144961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.148306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.158938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:42.175231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-937a9abd-2e24-4733-8872-73a541c0121f tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.572071 Apr 20 19:18:42.176365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 73/149] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:41 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:42.185429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:42.186301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:42.204395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.210974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.212137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.212769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.360096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-be047dc8-7996-44a8-8e50-a0bd78f2ffcd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 8992 microversion: 2.1 time: 0.246773 Apr 20 19:18:42.360956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 77/150] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:42 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 8992 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:42.416428 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-e9ad8c15-c455-41f3-bedc-baa3c39e5878 req-a98d0f79-c51a-4bdc-8e3c-c4dc68d4feaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:42.418799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:42.418799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:42.431558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-e9ad8c15-c455-41f3-bedc-baa3c39e5878 req-a98d0f79-c51a-4bdc-8e3c-c4dc68d4feaa service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.432336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-e9ad8c15-c455-41f3-bedc-baa3c39e5878 req-a98d0f79-c51a-4bdc-8e3c-c4dc68d4feaa service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.453783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-e9ad8c15-c455-41f3-bedc-baa3c39e5878 req-a98d0f79-c51a-4bdc-8e3c-c4dc68d4feaa service nova] Creating event network-changed:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:18:42.459949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-e9ad8c15-c455-41f3-bedc-baa3c39e5878 req-a98d0f79-c51a-4bdc-8e3c-c4dc68d4feaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053686 Apr 20 19:18:42.460785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 78/151] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:18:42.467911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:42.469230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:42.492253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.494269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:42.495526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:42.498514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.098640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:43.110370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-59c24459-a7c6-478c-abe4-de30e8a91232 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.932741 Apr 20 19:18:43.111225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 74/152] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:42 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:43.116681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:43.118149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:43.126777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.127463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.128411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.129157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.275326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a280b2b8-f93f-47d3-bfa0-0bce0bad6e92 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.161570 Apr 20 19:18:43.279594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 75/153] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:43 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:43.286434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:43.287532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:43.298446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.299194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.300259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.300948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.490652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:43.501570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df7d9fd0-7c5d-49d3-821d-ac1765035db7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 1.039281 Apr 20 19:18:43.502544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 79/154] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:42 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:43.516070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:43.517137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:43.525232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.525746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.526659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:43.527476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:43.656484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2aa7919d-5807-4289-8238-6e7a98a4b3b5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 15025 microversion: 2.1 time: 0.152226 Apr 20 19:18:43.657179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 80/155] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:43 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 15025 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:43.773999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:43.784635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2ddc0e43-3f9d-42fd-b257-eefaa50e90ca tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.502891 Apr 20 19:18:43.801227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 76/156] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:43 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:43.870462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-57ebe567-3fe6-4982-a6f4-b511d93d9524 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e028aea0>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:43.993318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-57ebe567-3fe6-4982-a6f4-b511d93d9524 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c8d353c7-6f30-4994-9672-28f9e1ad8a5b" status: 200 len: 350 microversion: 2.1 time: 0.127200 Apr 20 19:18:43.993998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 81/157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:18:43 2021] GET /compute/v2.1/os-volumes/c8d353c7-6f30-4994-9672-28f9e1ad8a5b => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:44.128775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:44.129444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:44.151328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.151833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.152685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.153168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.287881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:44.289704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:44.314850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.314850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.314850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.314850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.449446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-300efa34-6983-4adc-84b3-a5d5d0ac6d8b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.164773 Apr 20 19:18:44.450561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 82/158] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:44 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:18:44.487564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:44.504746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1ea8918b-9168-40d4-9a1d-f92c134a6dcf tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.379920 Apr 20 19:18:44.505383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 77/159] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:44 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:44.520931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:44.522489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:44.543579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.544223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.545043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.545555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.668741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:44.670075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:44.678036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.678547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.679392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.679937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.786499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e600f433-8086-41eb-89e0-c3f59e2adc8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 17104 microversion: 2.1 time: 0.121547 Apr 20 19:18:44.787184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 78/160] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:44 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 17104 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:44.802997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:44.803800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:44.812987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.813426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.814319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:44.814816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:44.850627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:44.859916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5e2a7b60-7ea5-475d-967e-55e51ec1b533 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.343677 Apr 20 19:18:44.860700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 83/161] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:44 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:45.038817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:45.051104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4bb55ed2-4092-4a4a-8508-93b045d2e195 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.252399 Apr 20 19:18:45.068983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:44 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:45.461977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:45.463157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:45.471464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.472080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.473002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.473652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.531008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:45.531909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:45.540212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.540970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.541977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.542606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.583888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-95ebc21d-a459-42f9-b046-7ce7f25f11cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.126473 Apr 20 19:18:45.587628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 84/163] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:45 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:45.765300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-230f8fc4-c205-4721-b38f-c2176e4e2549 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e028a400>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:45.818502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:45.830113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-353f9b67-077c-4c77-8300-15e9eb47d2b3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.309852 Apr 20 19:18:45.831214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 80/164] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:45 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:45.837467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:45.839322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:45.851026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.852050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.853870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.855536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.884961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-230f8fc4-c205-4721-b38f-c2176e4e2549 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f6096ac8-333d-4d18-becc-ae74ffd40636" status: 200 len: 351 microversion: 2.1 time: 0.124235 Apr 20 19:18:45.885811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 85/165] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:18:45 2021] GET /compute/v2.1/os-volumes/f6096ac8-333d-4d18-becc-ae74ffd40636 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:45.891248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-b1a35f13-d54c-40ff-8a41-424b2e8ba3c6 req-3898c785-ac87-4ade-889e-818cf1be185f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0", "name": "network-vif-plugged", "status": "completed", "tag": "7f8c033e-f0d1-45b1-a81b-fb977bf8b465"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:45.894601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:45.894601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:45.907786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b1a35f13-d54c-40ff-8a41-424b2e8ba3c6 req-3898c785-ac87-4ade-889e-818cf1be185f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.908737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b1a35f13-d54c-40ff-8a41-424b2e8ba3c6 req-3898c785-ac87-4ade-889e-818cf1be185f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.930849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-b1a35f13-d54c-40ff-8a41-424b2e8ba3c6 req-3898c785-ac87-4ade-889e-818cf1be185f service nova] Creating event network-vif-plugged:7f8c033e-f0d1-45b1-a81b-fb977bf8b465 for instance c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 on hv-cinder-78693 Apr 20 19:18:45.939283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-b1a35f13-d54c-40ff-8a41-424b2e8ba3c6 req-3898c785-ac87-4ade-889e-818cf1be185f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050767 Apr 20 19:18:45.940244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 86/166] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:45.946267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:45.947191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:45.955636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.956420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.957457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:45.958197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:45.993929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3697daad-9c82-4ef8-8858-6f0880cb796c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 17834 microversion: 2.1 time: 0.160890 Apr 20 19:18:45.995881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 81/167] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:45 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 17834 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:46.009441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-83e14236-2073-47db-9b39-e6c3499ac453 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e02746a8>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.182308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-83e14236-2073-47db-9b39-e6c3499ac453 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.183929 Apr 20 19:18:46.182997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 82/168] 10.222.0.48 () {58 vars in 1124 bytes} [Tue Apr 20 19:18:45 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:46.189699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.190722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:46.219909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.221469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.224384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.235083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.484925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:46.494044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fc58f625-e71c-4b5d-9183-9113002d0905 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.552308 Apr 20 19:18:46.498135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 87/169] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:45 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:46.499524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2a30f254-2880-4b4a-ac75-fca11e2cb84f tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e0265510>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.575889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:46.590467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2a30f254-2880-4b4a-ac75-fca11e2cb84f tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094547 Apr 20 19:18:46.591197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 88/170] 10.222.0.48 () {58 vars in 1139 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:46.597693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:46.598478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-435386b7-647b-4295-a5dc-033bb2c75d50 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.412224 Apr 20 19:18:46.598809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:46.599129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:46.605071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e5e45802-bc02-4d59-817e-c2530f173107 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e01fc598>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.608392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.608898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.609732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.610278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.698661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e5e45802-bc02-4d59-817e-c2530f173107 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098138 Apr 20 19:18:46.699293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 84/172] 10.222.0.48 () {58 vars in 1124 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:46.715161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-53270353-9626-4117-8d43-effdcb1347c5 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e022ad90>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.732049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4847e6dd-2fb3-4e2c-9087-4542a7e22b47 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.139453 Apr 20 19:18:46.732928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 89/173] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:46 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:46.805872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-53270353-9626-4117-8d43-effdcb1347c5 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094531 Apr 20 19:18:46.806770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 85/174] 10.222.0.48 () {58 vars in 1157 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:18:46.821316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9a1a7cf5-7e6d-4129-8db1-8d82f1b05f4f tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e03c5598>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.848837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:46.849648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:46.863466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.864055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.864994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:46.865576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:46.909925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9a1a7cf5-7e6d-4129-8db1-8d82f1b05f4f tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093169 Apr 20 19:18:46.910746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 90/175] 10.222.0.48 () {58 vars in 1160 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:46.923792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7a468bb3-6bc1-4fba-b027-1ba051e42918 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e038a400>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:47.019726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7a468bb3-6bc1-4fba-b027-1ba051e42918 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099704 Apr 20 19:18:47.020333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 91/176] 10.222.0.48 () {58 vars in 1145 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:47.029730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:47.031148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:47.039992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.040593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.041522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.042130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.129086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:47.139433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4057cbeb-15bf-4cbe-a69d-04d256fc0b5c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.294950 Apr 20 19:18:47.140318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 86/177] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:46 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:47.145278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b06ae303-aeb7-42e8-a0fe-cccb575f4fa8 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e0274730>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:47.177707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7e692cc1-5eea-435d-b029-d261e5b398aa tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 19342 microversion: 2.1 time: 0.152341 Apr 20 19:18:47.181806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 92/178] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:47 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 19342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:47.231692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b06ae303-aeb7-42e8-a0fe-cccb575f4fa8 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090234 Apr 20 19:18:47.232401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1178 bytes} [Tue Apr 20 19:18:47 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:47.245711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a00ff7ec-83d0-4da1-886a-c62d1f479256 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] Calling method '.version_select at 0x7fd8e0265d90>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:47.343506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a00ff7ec-83d0-4da1-886a-c62d1f479256 tempest-VolumesTestJSON-1357247860 tempest-VolumesTestJSON-1357247860-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102090 Apr 20 19:18:47.344379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1145 bytes} [Tue Apr 20 19:18:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:47.513471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:47.514298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:47.523894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.524531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.525483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.526160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.616827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:47.634128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:47.645012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.645543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.646475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.646983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.898482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:47.911560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-542514d7-5040-4be4-a772-eee25d2fcb02 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.403009 Apr 20 19:18:47.921295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 88/181] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:47 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:47.926263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:47.927274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:47.935113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.935627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.936828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:47.937309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:47.963926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:47.975069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8ffc7a29-9dbd-4279-864a-c88bffd2b0c9 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1313 microversion: 2.1 time: 0.362347 Apr 20 19:18:47.975982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:47 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:48.048728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9986de14-d023-4c5c-9ab3-e1cd0e0a902f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.126138 Apr 20 19:18:48.049485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 89/183] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:47 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:48.162374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:48.163290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:48.171882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.172437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.173329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.173823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.190941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:48.192083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:48.201013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.201518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.202340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.203162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.318145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d9e085d-179f-4548-94df-f72e06979b6e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 21281 microversion: 2.1 time: 0.131657 Apr 20 19:18:48.319877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 90/184] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:48 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 21281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:48.393972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:48.404728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e7bd795-cc58-49f2-a064-36c11d78346b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.247932 Apr 20 19:18:48.405866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 95/185] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:48 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:48.929678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:48.930480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:48.939551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.940055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.940894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:48.941389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:48.995187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:48.996177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:49.006883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.007550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.008936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.010032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.265884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:49.282885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dcb7dd8d-54e7-4d30-b2e2-63a1127b5331 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.357813 Apr 20 19:18:49.283688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 91/186] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:48 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:49.289042 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:49.290348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:49.299221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.299925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.300922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.301553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.341106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:49.351566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-74b9305d-5121-457f-89f9-15fec878440a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1498 microversion: 2.1 time: 0.361094 Apr 20 19:18:49.352197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 96/187] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:48 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1498 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:49.364927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:49.364927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:49.366207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.366839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.367963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.368457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.449504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e33d92a8-ed33-40e5-87d4-a833d5ebf3c2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 14 microversion: 2.20 time: 0.164202 Apr 20 19:18:49.450518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 92/188] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:49 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:49.459775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:49.460695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:49.469326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.469901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.470848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.471344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.517665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e9f4d773-5c0e-4aa6-a423-a3796964849b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 22765 microversion: 2.1 time: 0.163630 Apr 20 19:18:49.523634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 97/189] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:49 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 22765 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:49.529959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-65443b52-a952-44e0-8bde-314e3ff8226f req-8102419e-b472-4adf-8892-5cdc31a02b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358d3991-d8f0-4906-b8b5-33be33d27480", "name": "network-vif-plugged", "status": "completed", "tag": "cdfa5087-dd7b-4e2e-bec8-adc661ef0728"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:49.535766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:49.535766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:49.561128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-65443b52-a952-44e0-8bde-314e3ff8226f req-8102419e-b472-4adf-8892-5cdc31a02b00 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:49.561632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-65443b52-a952-44e0-8bde-314e3ff8226f req-8102419e-b472-4adf-8892-5cdc31a02b00 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:49.580113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-65443b52-a952-44e0-8bde-314e3ff8226f req-8102419e-b472-4adf-8892-5cdc31a02b00 service nova] Creating event network-vif-plugged:cdfa5087-dd7b-4e2e-bec8-adc661ef0728 for instance 358d3991-d8f0-4906-b8b5-33be33d27480 on hv-cinder-78693 Apr 20 19:18:49.585266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-65443b52-a952-44e0-8bde-314e3ff8226f req-8102419e-b472-4adf-8892-5cdc31a02b00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059817 Apr 20 19:18:49.585965 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 98/190] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:49.721953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:49.734147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-008d788b-afe5-4268-8856-a19ef71ccb1b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.278459 Apr 20 19:18:49.736086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:49 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:50.286221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:50.286811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.295142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.295627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.296480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.296972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.301191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:50.301944 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.310917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.311513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.312475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.313022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.366261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:18:50.491370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bc0eec92-43d2-461b-9db0-86962c0d6139 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 204 len: 0 microversion: 2.1 time: 0.209829 Apr 20 19:18:50.492024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:18:50 2021] DELETE /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:18:50.499532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:50.500651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.508659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.509162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.509969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.510455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.534573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:50.544194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6df2a1e6-36b7-4d70-abfe-912ad0b9f86c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1317 microversion: 2.1 time: 0.247209 Apr 20 19:18:50.544802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:50 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:50.549805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:50.550457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.560880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.561394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.562296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.562794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.644311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3dc7b47f-f494-44df-8559-d2ee5e72feb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 6257 microversion: 2.20 time: 0.150574 Apr 20 19:18:50.647053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 100/194] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:50 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 6257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:50.651514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:50.652630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.660992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.661505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.662379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.662843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.775752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:50.786340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-38ffff1f-ef60-48a9-973e-aa3d964aa1ac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1504 microversion: 2.1 time: 0.240308 Apr 20 19:18:50.786957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:50 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:50.791852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:50.792515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:50.800537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.800980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.801860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:50.802364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:50.810862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d8dcc502-9832-4b4e-982c-f8d6b724d304 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 23594 microversion: 2.1 time: 0.164328 Apr 20 19:18:50.815177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 101/196] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:50 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 23594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:51.020155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:51.029400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4e000917-ea5b-4c18-b744-3a2e39804d24 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.241351 Apr 20 19:18:51.030021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:50 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:51.563690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:51.564425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:51.573723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.574288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.575138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.575778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.656810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:51.658801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:51.684715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.685223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.686117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.686603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.826957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-076f463a-8f01-439d-aa65-fa6e4dc09022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 8153 microversion: 2.20 time: 0.174361 Apr 20 19:18:51.827860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 97/198] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:51 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 8153 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:18:51.832581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:51.833908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:51.834748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:51.845945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-87d6c154-2fe8-4877-ae3c-4aef7a0e3a12 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1507 microversion: 2.1 time: 0.283517 Apr 20 19:18:51.845945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 102/199] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:51 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:51.846164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.846164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.846164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.846164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.849362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:51.850693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:51.859446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.859952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.860787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:51.861273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:51.996593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1a182967-2fc6-4cbd-89ff-7d0eaa6ec804 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 24255 microversion: 2.1 time: 0.151285 Apr 20 19:18:52.001377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 103/200] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:51 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 24255 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:52.005936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52cb923a-a068-4514-a410-d931ad5938ac"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:52.007314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:52.022489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.023077 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.023987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.024545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.083009 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:52.092729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d3f557ab-c92a-4ed6-b97d-b2e495395658 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1504 microversion: 2.1 time: 0.263385 Apr 20 19:18:52.104144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 98/201] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:51 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:52.108885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:52.109549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:52.118254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.118772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.119643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.120139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.228330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Invalid volume: volume 52cb923a-a068-4514-a410-d931ad5938ac is already attached to instances: 3a3e0d30-5d56-4781-baab-a9ef97961235 Apr 20 19:18:52.229148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 400 to user: Invalid volume: volume 52cb923a-a068-4514-a410-d931ad5938ac is already attached to instances: 3a3e0d30-5d56-4781-baab-a9ef97961235 {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:18:52.230155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a0c206a4-00ad-4282-9089-f85d0e9b6fa2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.231404 Apr 20 19:18:52.230866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 104/202] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:18:51 2021] POST /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480/os-volume_attachments => generated 174 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:18:52.353014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:52.353571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:52.367887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.368406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.370058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.370554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.383552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:52.393954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6b03b9d2-8a21-4bf2-afe9-8eac9f5b798d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.288774 Apr 20 19:18:52.394895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 99/203] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:52 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:52.553328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'services' on Instance uuid 3a3e0d30-5d56-4781-baab-a9ef97961235 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:18:52.703919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5c206aa3-bdbf-4bf8-a162-b8099923bd8d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235/os-volume_attachments/52cb923a-a068-4514-a410-d931ad5938ac" status: 202 len: 0 microversion: 2.1 time: 0.354894 Apr 20 19:18:52.704671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 105/204] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:18:52 2021] DELETE /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235/os-volume_attachments/52cb923a-a068-4514-a410-d931ad5938ac => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:18:52.839335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:52.840617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:52.851381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.851381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:52.851381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:52.851381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:53.012132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:53.013277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:53.021615 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:53.022151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:53.022988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:53.023468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:55.594354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-50f83426-69fc-4a95-b7a4-865597ac7687 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 26235 microversion: 2.1 time: 2.588439 Apr 20 19:18:55.595096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 106/205] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:53 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 26235 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:55.598038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-386cf6f1-d724-41e3-9368-c623ae04dc41 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 17602 microversion: 2.20 time: 2.762357 Apr 20 19:18:55.601150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:55.601919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:55.602144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 100/206] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:52 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 17602 bytes in 2768 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:18:55.607876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:55.608663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:55.611575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:55.612145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:55.613043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:55.613551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:55.618368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:55.618954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:55.619923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:55.620474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:55.940104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:55.948176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:55.949909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dd2b109d-54cd-4e3b-9d9d-65e24a253f22 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1504 microversion: 2.1 time: 0.353325 Apr 20 19:18:55.951054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 107/207] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:55 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:55.957572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1889bb4a-17d1-4ee8-ba62-04676ee7155e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.354088 Apr 20 19:18:55.958780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:55 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:56.608449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:56.610271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:56.613142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:56.614357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:56.621612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.622465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.623940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.624613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.626218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.627470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.628568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.630008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.759896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8d241618-3df7-46dd-b08a-c602d347ecad tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 26750 microversion: 2.1 time: 0.155251 Apr 20 19:18:56.760736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 108/209] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:56 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 26750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:56.769145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-52b8d0f2-4797-40bd-ab8c-d19e064000fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 17602 microversion: 2.20 time: 0.162968 Apr 20 19:18:56.769977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 102/210] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:56 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 17602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:18:56.968954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:56.971846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:56.978024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:56.979423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:56.981467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.982060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.983135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.983717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.990787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.991288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:56.992128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:56.992613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:57.584346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:57.593634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6458b0bd-ea76-4a05-9c8e-576270a1bc34 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.621097 Apr 20 19:18:57.593791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:57.594891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 103/211] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:56 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:57.603290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6cbb921e-77de-4a57-9700-18926fcb0486 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 200 len: 1504 microversion: 2.1 time: 0.638787 Apr 20 19:18:57.603880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 109/212] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:56 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:57.609032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1118806800", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "a3d56b3d-c47b-49ff-9e13-42db36c3dbd5"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:57.609803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-4ec65edd-5b47-4073-add4-e6f313e3a6c5 req-0db5613d-2de3-4ed9-a3ef-979e32353679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0", "name": "network-vif-deleted", "tag": "7f8c033e-f0d1-45b1-a81b-fb977bf8b465"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:57.611490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:18:57.611490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:18:57.622534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4ec65edd-5b47-4073-add4-e6f313e3a6c5 req-0db5613d-2de3-4ed9-a3ef-979e32353679 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:57.623196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4ec65edd-5b47-4073-add4-e6f313e3a6c5 req-0db5613d-2de3-4ed9-a3ef-979e32353679 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:57.644984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-4ec65edd-5b47-4073-add4-e6f313e3a6c5 req-0db5613d-2de3-4ed9-a3ef-979e32353679 service nova] Creating event network-vif-deleted:7f8c033e-f0d1-45b1-a81b-fb977bf8b465 for instance c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 on hv-cinder-78693 Apr 20 19:18:57.650046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-4ec65edd-5b47-4073-add4-e6f313e3a6c5 req-0db5613d-2de3-4ed9-a3ef-979e32353679 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044945 Apr 20 19:18:57.650700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 110/213] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:18:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:18:57.683267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] validate_networks() for [('a3d56b3d-c47b-49ff-9e13-42db36c3dbd5', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:57.773875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:57.776792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:57.785146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:57.785653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:57.786524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:57.787015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:57.905260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-88deb4bd-a6f4-4549-a62d-53fec4febefd tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 27168 microversion: 2.1 time: 0.135715 Apr 20 19:18:57.907550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 111/214] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:57 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 27168 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:18:57.912053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:57.913162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:57.921871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:57.922867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:57.923211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:57.923706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.032920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ab5401d-e617-4e7a-896e-95b29d886f44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 19342 microversion: 2.20 time: 0.125188 Apr 20 19:18:58.033979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 112/215] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:57 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 19342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:18:58.260627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:58.261275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:58.261797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:58.262320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:58.262786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:58.272415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.272997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.273924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.274405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.293540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:58.297945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for user 825e0fb1ce1741fd9735f09cd3da24b2 and project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:58.310973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:58.313750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:58.367655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a8486b04-6460-49f0-bd99-23e081fa47f0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762464 Apr 20 19:18:58.368372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 104/216] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:18:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:18:58.380259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ccb3964d-cb48-4351-8d3e-f5c0be150cea tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:58.381845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ccb3964d-cb48-4351-8d3e-f5c0be150cea tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:58.500535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ccb3964d-cb48-4351-8d3e-f5c0be150cea tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:58.509979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ccb3964d-cb48-4351-8d3e-f5c0be150cea tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1218 microversion: 2.1 time: 0.134327 Apr 20 19:18:58.525194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 113/217] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:58 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:58.612790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:58.613467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:58.622291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.623033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.624262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.624765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.626178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:58.627109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:58.637338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.637871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.638723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.639191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.692185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] HTTP exception thrown: Instance c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 could not be found. Apr 20 19:18:58.692878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Returning 404 to user: Instance c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:18:58.693871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0aa486ef-e598-4bce-b6c3-d53fa11c7f76 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0" status: 404 len: 111 microversion: 2.1 time: 0.075873 Apr 20 19:18:58.694870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 114/218] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:58 2021] GET /compute/v2.1/servers/c81dc4d7-b966-4b5b-92e5-ee7a746ff8c0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:18:58.821608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2062340298", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "530fe84c-bb97-495f-92fc-7c17dfae2367"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:58.888015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:58.896500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] validate_networks() for [('530fe84c-bb97-495f-92fc-7c17dfae2367', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:18:58.898941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8081cbfa-bebe-4ee1-9ac3-c537790af40b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.290715 Apr 20 19:18:58.899567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 105/219] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:58 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:58.920120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:58.921604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:58.931349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.931883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:58.932665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:58.933149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.088518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a019ba12-62bd-43df-8121-09da964b594f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 27610 microversion: 2.1 time: 0.172814 Apr 20 19:18:59.093670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 106/220] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:18:58 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 27610 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:18:59.100897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:18:59.102349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:59.112352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.112936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.113857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.114356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.248288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b55031f5-2e43-4979-946e-4af39abd5b54 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 21713 microversion: 2.20 time: 0.151748 Apr 20 19:18:59.249207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 107/221] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:18:59 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 21713 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:18:59.530370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:59.531977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:59.541279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.542955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.544457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.545159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.730354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:18:59.732126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:18:59.732732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:18:59.733417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:18:59.734065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:18:59.734662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:18:59.745632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.746386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.747596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.748328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.759948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ac5e567c-8824-4138-aad0-015ba79a3bad tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1270 microversion: 2.1 time: 0.235194 Apr 20 19:18:59.762654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 108/222] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:59 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:18:59.786125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Getting quotas for project 3c847e04a33b45a68c63a63c3ff855fd. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:18:59.792055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Getting quotas for user 474d34cc538f4d809474e0571b0db346 and project 3c847e04a33b45a68c63a63c3ff855fd. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:18:59.806689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:18:59.810268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:18:59.874357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3da2b015-12eb-4fc5-a9a9-5887519288ef tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056764 Apr 20 19:18:59.875666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 115/223] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:18:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:18:59.890442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3ee11f81-0cd0-42b7-8ac1-8d5db5d4abac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:59.891566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3ee11f81-0cd0-42b7-8ac1-8d5db5d4abac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:59.917972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:18:59.918862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:18:59.931780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.932484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:18:59.933507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:18:59.934435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.059284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3ee11f81-0cd0-42b7-8ac1-8d5db5d4abac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:00.071113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3ee11f81-0cd0-42b7-8ac1-8d5db5d4abac tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1214 microversion: 2.1 time: 0.187216 Apr 20 19:19:00.074811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 109/224] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:59 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:00.101595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:00.103290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:00.123780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.124304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.125204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.125813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.282588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0f4226b8-45b6-4289-ba3c-87464e53f09c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 27853 microversion: 2.1 time: 0.184658 Apr 20 19:19:00.288056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 110/225] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:00 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 27853 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:00.294643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:00.296319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:00.307159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.308156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.309173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.309800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.437515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c29d6967-3682-44c2-9808-930fbadba411 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 22903 microversion: 2.20 time: 0.147495 Apr 20 19:19:00.438420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 111/226] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:00 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 22903 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:00.737471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:00.753370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3586ac3b-9c51-4067-abd8-bfc4b976cf06 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.838365 Apr 20 19:19:00.753370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 116/227] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:18:59 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:00.779852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:00.780780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:00.789702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.790414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:00.791377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:00.792005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.092749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:01.093423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:01.104731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.105327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.106172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.109310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.339933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:01.344453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:01.355555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-98a9b52f-a92b-4bf5-98a3-cb5db7983238 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1266 microversion: 2.1 time: 0.266038 Apr 20 19:19:01.358542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 117/228] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:01 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:01.362129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-50ac9ed3-8c9e-45e2-9354-62898fb9ac46 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1276 microversion: 2.1 time: 0.586714 Apr 20 19:19:01.371197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 112/229] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:00 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1276 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:01.372742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:01.375914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:01.397993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.398508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.399367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.403120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.450566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:01.452522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:01.480468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.480958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.481957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.482719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.597906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ed260e92-6648-44e9-8bb6-a86535e1baa9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28151 microversion: 2.1 time: 0.237714 Apr 20 19:19:01.598617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 118/230] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:01 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28151 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:01.656407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-80edcb38-c072-4a81-90f8-4662bdf77b2d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 23809 microversion: 2.20 time: 0.210099 Apr 20 19:19:01.657286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 113/231] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:01 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 23809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:19:01.769608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:01.771331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:01.798536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.799043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:01.799907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:01.800398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.380477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:02.382357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:02.393166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.394039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.395343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.396063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.441138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:02.455959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ff89f775-3719-456d-9b42-77ca06ea2c11 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.690575 Apr 20 19:19:02.467011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 119/232] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:01 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:02.472849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:02.473672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:02.483801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.484535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.485707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.486335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.602611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:02.613164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a60b49c-723d-4710-a9fc-3c85bab2c29d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1272 microversion: 2.1 time: 0.237374 Apr 20 19:19:02.614527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 114/233] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:02 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:02.620043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:02.621371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:02.630359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.631155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.632222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:02.632899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:02.978784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:02.988302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84f2de89-a2f5-4bf6-bdd0-743366dc3703 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.519834 Apr 20 19:19:02.989184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 120/234] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:02 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:02.994880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:02.996119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:03.004622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:03.005421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:03.007247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:03.008011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.458206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-393c554b-16a6-4876-9313-c99f265c867a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28151 microversion: 2.1 time: 2.841969 Apr 20 19:19:05.458903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 115/235] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:02 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28151 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:05.464596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:05.465494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:05.474825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.475336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.476268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.476755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.479034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e9035522-1afc-4b88-85b5-de8e2def8db4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 27230 microversion: 2.20 time: 2.488020 Apr 20 19:19:05.483726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 121/236] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:02 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 27230 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:05.489637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-3291eb4b-8e76-4793-b272-0d70566a84e5 req-45349c9a-9b86-407c-bd17-7d5b5ca70947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849c1a32-0a61-408c-9cae-f0931eb6b1e3", "tag": "6455816e-56e4-494c-9c38-9280518b6817"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:05.491401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:05.491401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:05.501544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-3291eb4b-8e76-4793-b272-0d70566a84e5 req-45349c9a-9b86-407c-bd17-7d5b5ca70947 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.502327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-3291eb4b-8e76-4793-b272-0d70566a84e5 req-45349c9a-9b86-407c-bd17-7d5b5ca70947 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.525593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-3291eb4b-8e76-4793-b272-0d70566a84e5 req-45349c9a-9b86-407c-bd17-7d5b5ca70947 service nova] Creating event network-changed:6455816e-56e4-494c-9c38-9280518b6817 for instance 849c1a32-0a61-408c-9cae-f0931eb6b1e3 on hv-cinder-78693 Apr 20 19:19:05.530941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-3291eb4b-8e76-4793-b272-0d70566a84e5 req-45349c9a-9b86-407c-bd17-7d5b5ca70947 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045654 Apr 20 19:19:05.531596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 122/237] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:05.537689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:05.538525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:05.547309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.547794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.548631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.549126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.910551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:05.930464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c980cf44-a543-4d0a-beaa-55e3609c170a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.464773 Apr 20 19:19:05.931191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 116/238] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:05 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:05.942292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:05.942980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:05.975315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.975848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:05.976724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:05.977240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.214740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:06.227208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1468cb09-b461-4e82-92c0-1b518248a747 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.694287 Apr 20 19:19:06.227891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 123/239] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:05 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:06.435410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-846b5e2b-09fb-4130-9c2e-922902460119 req-d041fae0-11bc-42c2-beb2-c87c412c45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1af3b7-2128-458a-ab17-1f0540b79324", "tag": "fe527323-afc8-4594-99da-d6773e29d93f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:06.437217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:06.437217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:06.446524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-846b5e2b-09fb-4130-9c2e-922902460119 req-d041fae0-11bc-42c2-beb2-c87c412c45d7 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.446856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-846b5e2b-09fb-4130-9c2e-922902460119 req-d041fae0-11bc-42c2-beb2-c87c412c45d7 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.465255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-846b5e2b-09fb-4130-9c2e-922902460119 req-d041fae0-11bc-42c2-beb2-c87c412c45d7 service nova] Creating event network-changed:fe527323-afc8-4594-99da-d6773e29d93f for instance 5d1af3b7-2128-458a-ab17-1f0540b79324 on hv-cinder-78693 Apr 20 19:19:06.470443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-846b5e2b-09fb-4130-9c2e-922902460119 req-d041fae0-11bc-42c2-beb2-c87c412c45d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039016 Apr 20 19:19:06.471117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 124/240] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:19:06.476690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:06.477817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:06.482264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:06.486363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.486851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.487810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.488238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.495418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-02813610-5e52-4434-a161-1b10448d5941 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.562749 Apr 20 19:19:06.496610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 117/241] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:05 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:06.506877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:06.508402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:06.518840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.519849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.522308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.522937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.681067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-45c29105-a34c-428e-9b67-aa3ea4ee1b85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 27509 microversion: 2.20 time: 0.182622 Apr 20 19:19:06.682035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 118/242] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:06 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 27509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:06.691454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-aadd1f6d-02be-486b-88c6-cd22da94c1bc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28151 microversion: 2.1 time: 0.218648 Apr 20 19:19:06.692466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 125/243] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:06 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28151 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:06.949628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:06.950422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:06.959612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.960092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:06.960947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:06.961439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.248559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:07.250215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:07.263345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.264612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.266450 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.267885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.727480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:07.738681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5a6282e2-5dc8-4ee3-ab98-109747ca070d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.793106 Apr 20 19:19:07.748927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 119/244] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:06 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:07.748927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:07.748927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:07.755385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.755883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.756716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.757200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.780742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:07.789819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3b46793b-72de-416c-99cd-eb30bf11a746 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.548542 Apr 20 19:19:07.790747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 126/245] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:07 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:07.805233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:07.806321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:07.824062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.824454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.825672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:07.826346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:07.994671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:08.003650 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a83f8cb5-2b58-4aac-9ead-f7e38caa8ee2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.262573 Apr 20 19:19:08.004267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 120/246] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:07 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:08.008979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:08.010160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:08.017709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:08.018250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:08.019210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:08.019700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:10.803752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6301d40c-5c21-460e-b011-26646baec001 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28151 microversion: 2.1 time: 2.798077 Apr 20 19:19:10.804462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 121/247] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:08 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28151 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:10.809951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:10.810102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-47f7c9b7-63bc-405b-b955-557035ea8ac6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 27869 microversion: 2.20 time: 3.018155 Apr 20 19:19:10.810936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:10.811041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 127/248] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:07 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 27869 bytes in 3020 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:10.820048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:10.820216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:10.820722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:10.820827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:10.821670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:10.822186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:10.829521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:10.830076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:10.830957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:10.831451 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.212157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:11.217662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:11.222099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e1d8d928-c3c7-4a3f-a19d-5057d51c5611 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1522 microversion: 2.1 time: 0.416335 Apr 20 19:19:11.222836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 122/249] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:10 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:11.227429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:11.228090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:11.234264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9d224b35-25e2-4fe3-9ac3-a3b2c1135abf tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.418613 Apr 20 19:19:11.235147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 128/250] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:10 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:11.236839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.237321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.238186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.238675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.455676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:11.464878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cbd90bcb-a253-4f0b-9d73-cb80f8c79f71 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.241071 Apr 20 19:19:11.465700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 123/251] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:11 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:11.816192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:11.822380 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:11.823595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:11.826078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:11.838149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.838633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.838820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.839488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.840346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.840629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:11.840831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.841423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:11.976861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e49592a-0c2e-4d89-b8eb-3ee614937802 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28437 microversion: 2.1 time: 0.163666 Apr 20 19:19:11.977874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 129/252] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:11 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28437 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:11.985968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-30599393-8345-4789-b25b-c877ddabdefc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 0.167536 Apr 20 19:19:11.990350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 124/253] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:11 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:19:12.241239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:12.242389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:12.255338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:12.255737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.256214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.256328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:12.257067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.257560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.266734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.267245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.268133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.268657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.533167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:12.542801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d473021b-dfd2-4af9-9c5f-76a71e9c681a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.294145 Apr 20 19:19:12.543429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 125/254] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:12 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:12.550534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:12.551449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:12.559749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.560352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.561299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.561958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.740757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:12.749917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-268f3950-1ad2-4f4d-b1d0-34e4c0a6f4fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1502 microversion: 2.1 time: 0.513093 Apr 20 19:19:12.750575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 130/255] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:12 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1502 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:12.766985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:12.767640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:12.775472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.776090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.776920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.777437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:12.822841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:12.832147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2ee2f33e-6770-4954-a0b7-8333fd27a241 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.287371 Apr 20 19:19:12.832774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 126/256] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:12 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:12.989424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:12.990513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:12.992648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:12.998848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:12.999358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:13.000248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:13.000744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:13.002076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-42ed39c9-ba17-4837-97ec-27f866c6f1e8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1516 microversion: 2.1 time: 0.238838 Apr 20 19:19:13.002702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 131/257] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:12 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:13.007497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:13.008613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:13.016703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:13.017128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:13.018114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:13.018587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:15.871823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-448068b3-e3da-4864-bde8-796001d3a480 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 2.867028 Apr 20 19:19:15.872817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 132/258] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:13 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:15.880347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:15.881107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:15.889792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:15.890345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:15.891179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:15.891671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:15.897519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-555053e9-0c52-4611-85c4-927d2ab0b807 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28437 microversion: 2.1 time: 2.912081 Apr 20 19:19:15.898250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 127/259] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:12 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28437 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:19:15.903863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:15.904625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:15.913281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:15.913791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:15.914653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:15.915148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:16.214822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:16.220939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:16.228013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-54e9f0ef-397e-4a64-a50c-f158776a9547 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.353000 Apr 20 19:19:16.228742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 133/260] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:15 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:16.235318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e56f849e-a984-42c6-8e9c-e78d4f3b9cfa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.335549 Apr 20 19:19:16.236222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 128/261] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:15 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:16.891267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:16.893047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:16.901954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:16.902476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:16.903338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:16.903821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:16.910396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:16.911456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:16.920021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:16.920531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:16.921373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:16.921866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.415661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8676da03-f936-417a-b7c7-8e924cd5229f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 2.531150 Apr 20 19:19:19.416370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 134/262] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:16 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:19:19.421698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:19.423033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:19.432007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:19.432543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.433339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:19.437365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b5d2047d-5cc6-44ac-83ae-4a0bfd687e85 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 2.530852 Apr 20 19:19:19.438899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 129/263] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:16 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:19.443466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:19.444235 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:19.450530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.457336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:19.457984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.458905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:19.459644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.782246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:19.785456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:19.791463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31e9af2b-15bc-4879-837a-0e0c0cc9b728 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.373867 Apr 20 19:19:19.792073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 135/264] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:19 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:19.796862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-3822df80-fcac-4cb5-a53f-67b9a8233c5f req-10acbf1d-de98-4fbf-9e4a-5f48393c7481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849c1a32-0a61-408c-9cae-f0931eb6b1e3", "name": "network-vif-plugged", "status": "completed", "tag": "6455816e-56e4-494c-9c38-9280518b6817"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:19.799166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:19.799166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:19.805149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-98b5806a-42c9-48f7-baa9-38ca698c5952 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.365730 Apr 20 19:19:19.805763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 130/265] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:19 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:19.818980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-3822df80-fcac-4cb5-a53f-67b9a8233c5f req-10acbf1d-de98-4fbf-9e4a-5f48393c7481 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:19.819471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-3822df80-fcac-4cb5-a53f-67b9a8233c5f req-10acbf1d-de98-4fbf-9e4a-5f48393c7481 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:19.836818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-3822df80-fcac-4cb5-a53f-67b9a8233c5f req-10acbf1d-de98-4fbf-9e4a-5f48393c7481 service nova] Creating event network-vif-plugged:6455816e-56e4-494c-9c38-9280518b6817 for instance 849c1a32-0a61-408c-9cae-f0931eb6b1e3 on hv-cinder-78693 Apr 20 19:19:19.841939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-3822df80-fcac-4cb5-a53f-67b9a8233c5f req-10acbf1d-de98-4fbf-9e4a-5f48393c7481 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048653 Apr 20 19:19:19.842786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 136/266] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:20.434319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:20.436013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:20.449015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.449908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.451298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.452117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.456411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:20.457552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:20.466682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.467195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.468108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.468597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.561905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-20870945-54ab-42b8-aad9-1cd5f1b1edc4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 0.134441 Apr 20 19:19:20.562636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 131/267] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:20 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:20.568715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-67a266ff-bd62-4f34-9f04-7637f3b61c24 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.120544 Apr 20 19:19:20.569400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 137/268] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:20 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:20.814427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:20.815299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:20.824225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.824377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:20.824737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.825265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:20.825582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.826114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.834561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.835164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:20.836084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:20.836647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.149629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:21.157441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:21.161248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d9a6c7c3-bcf7-4581-976f-f76c92e72bc8 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.353472 Apr 20 19:19:21.162155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 132/269] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:20 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:21.170086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dfea5628-0d5b-45c4-a06b-aa1a02e6ddc3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1318 microversion: 2.1 time: 0.347901 Apr 20 19:19:21.170086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 138/270] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:20 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:21.234766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:21.235969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:21.244222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.244734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.245580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.246100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.310334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'flavor' on Instance uuid eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:19:21.475306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-80d3b842-1398-495c-8864-3eac98338d3d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action" status: 200 len: 32 microversion: 2.1 time: 0.244493 Apr 20 19:19:21.480667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 139/271] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:21 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:19:21.486134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:21.486928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:21.505768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.506314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.507480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.513393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.574748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:21.576403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:21.587147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.588078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.589418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.590123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.750129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-00cb5204-1b0d-4c55-aedb-06f9b483379d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 0.179810 Apr 20 19:19:21.750980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 140/272] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:21 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:21.762374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:21.764318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:21.773715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.774181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.775036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.775527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.897255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c75db360-7c60-48f1-91a5-1cd1f52a3c14 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.144630 Apr 20 19:19:21.898023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 141/273] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:21 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:21.903483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-890ebe63-ddfe-44d8-81f3-3225af7ff354 req-d6379222-a932-44ea-8f6d-11100d0c5bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1af3b7-2128-458a-ab17-1f0540b79324", "name": "network-vif-plugged", "status": "completed", "tag": "fe527323-afc8-4594-99da-d6773e29d93f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:21.905100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:21.905100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:21.914849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-890ebe63-ddfe-44d8-81f3-3225af7ff354 req-d6379222-a932-44ea-8f6d-11100d0c5bb8 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:21.915386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-890ebe63-ddfe-44d8-81f3-3225af7ff354 req-d6379222-a932-44ea-8f6d-11100d0c5bb8 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:21.933367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-890ebe63-ddfe-44d8-81f3-3225af7ff354 req-d6379222-a932-44ea-8f6d-11100d0c5bb8 service nova] Creating event network-vif-plugged:fe527323-afc8-4594-99da-d6773e29d93f for instance 5d1af3b7-2128-458a-ab17-1f0540b79324 on hv-cinder-78693 Apr 20 19:19:21.938723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-890ebe63-ddfe-44d8-81f3-3225af7ff354 req-d6379222-a932-44ea-8f6d-11100d0c5bb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039302 Apr 20 19:19:21.939376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 142/274] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:21.943151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:21.952615 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a79ed64c-2b07-4196-bc43-91ad74deb289 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.470865 Apr 20 19:19:21.953228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 133/275] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:21 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:22.185683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:22.186992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:22.190333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:22.191508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:22.200910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.201702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.203173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.204644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.204855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.205590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.206547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.206984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.534775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:22.539590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:22.544048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-68c8f4fd-5c6e-4f7e-930b-a7d6bdddb307 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.365889 Apr 20 19:19:22.544901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 143/276] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:22 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:22.550081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fc872196-c60b-4a4b-b800-876c80233dac tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1508 microversion: 2.1 time: 0.366353 Apr 20 19:19:22.550959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 134/277] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:22 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:22.762626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:22.763682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:22.773316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.774099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.774933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.775433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.910492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:22.911733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:22.919919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.920510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:22.921873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:22.922393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:25.225860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ebd882fe-9428-4952-9140-b4bc48560df0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28229 microversion: 2.20 time: 2.467149 Apr 20 19:19:25.227206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 144/278] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:22 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28229 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:25.234216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d32dbd19-c1fe-4e44-8210-bf1c081b3c5c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 2.328995 Apr 20 19:19:25.235188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 135/279] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:22 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:19:25.240720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:25.245239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:25.246100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:25.247102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:25.263992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:25.264502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:25.265361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:25.265865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:25.268815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:25.269389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:25.270535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:25.271034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:25.965289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:25.977149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fffad567-f90f-43aa-a93a-066e7bc62e46 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1314 microversion: 2.1 time: 0.740658 Apr 20 19:19:25.978772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 136/280] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:25 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:25.979025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:25.988369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a52d0762-ab29-4eda-b078-4641d60d6ba3 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.759772 Apr 20 19:19:25.989172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 145/281] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:25 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:26.239310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:26.240435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:26.247568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:26.248726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.249304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.249532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:26.250149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.250653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.258312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.259000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.259990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.260609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.401322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9b3eb103-720f-479f-a4a4-9e9091577d12 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28515 microversion: 2.20 time: 0.165694 Apr 20 19:19:26.402134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 137/282] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:26 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:26.408853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c3fa849-3635-491e-b8cc-9908db04da68"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:26.410284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:26.412745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c0b7e7bd-7df2-4901-a9f0-615ecab01fe9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.169100 Apr 20 19:19:26.413809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 146/283] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:26 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:19:26.420732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.421273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.422171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:26.422687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:26.822456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d1ad93a-c7dd-498f-920c-d12343f6dac0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418269 Apr 20 19:19:26.823131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 138/284] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:19:26 2021] POST /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:26.998089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:26.998980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:27.008327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:27.008706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.009311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.009801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:27.010379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.010972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.020148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.021062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.022538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.023170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.361935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:27.369649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:27.371740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2a1915df-55aa-4123-8293-c687cbd3ac7b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.368060 Apr 20 19:19:27.372369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 139/285] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:27 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:27.378804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-560fc1b2-7c38-4552-9258-0a0fbf501fea tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1498 microversion: 2.1 time: 0.385956 Apr 20 19:19:27.379617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 147/286] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:26 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1498 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:27.415204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:27.416334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:27.425246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.425417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:27.425757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.426612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.426738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:27.427096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.434950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.435538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:27.436489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:27.437062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:30.596085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2937121c-c8bc-4287-9ea5-56a1ab0b81c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28515 microversion: 2.20 time: 3.184791 Apr 20 19:19:30.597118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 140/287] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:27 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28515 bytes in 3187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:30.602903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:30.603769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:30.606861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1985bc2d-ff07-45bc-9eb2-8b6df3274f4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 3.185305 Apr 20 19:19:30.607595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 148/288] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:27 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 3187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:30.613054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:30.613652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:30.614633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:30.615150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:30.835113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:30.844719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9c800b22-84df-47a8-a8d3-5d17f242c356 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.246248 Apr 20 19:19:30.845412 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 141/289] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:30 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:31.610473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:31.611483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:31.620374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:31.621646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:31.621808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.622175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:31.623237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.623758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:31.630572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.631084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:31.632006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.632510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:31.759798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-810157ca-37da-4357-a0c9-37a81474617d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.153891 Apr 20 19:19:31.760913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 149/290] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:31 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:31.777157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-afa9e2d1-acb6-4ec9-a7e5-e765308a6c12 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.160988 Apr 20 19:19:31.777874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 142/291] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:31 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:31.866103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:31.866771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:31.876532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.877087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:31.878037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:31.878573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:32.102993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:32.114834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7a6acbbe-66a6-4add-bf53-c53a8c458e02 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.254116 Apr 20 19:19:32.115655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 150/292] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:31 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:32.780378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:32.782283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:32.790936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:32.792019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:32.792603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:32.793550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:32.794571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:32.795131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:32.800915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:32.801426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:32.802297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:32.802784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:35.399782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-62b53cf6-507a-46b2-b4c2-e33d792d83f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 2.626408 Apr 20 19:19:35.401036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 143/293] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:32 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 2630 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:35.409637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:35.410939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:35.423621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-61dcf483-35bd-4290-9201-624b1279430b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 2.636008 Apr 20 19:19:35.424683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 151/294] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:32 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:35.425253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:35.425765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:35.426645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:35.427139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:35.666769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:35.681757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1727ade8-5082-4970-97bb-a9e7c85be233 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.278723 Apr 20 19:19:35.682630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 144/295] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:35 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:36.303209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:36.303852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:36.312531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.313031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.313872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.314366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.382260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:19:36.415268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:36.417792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:36.428896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.432238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.433447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.434152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.524116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b0b9d03d-a13e-42f9-a471-c8816105a768 tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 204 len: 0 microversion: 2.1 time: 0.225141 Apr 20 19:19:36.533864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 152/296] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:19:36 2021] DELETE /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:19:36.534082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:36.535072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:36.543605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.544025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.544858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.545350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.575363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-511b0c9b-37c7-476b-8b3e-ea3c872c3bec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.162266 Apr 20 19:19:36.576809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 145/297] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:36 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:36.582626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:36.583633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:36.592835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.593580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.594666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.595353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.665633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e6ac25b3-c0b4-4cca-9306-4df532f5bfb6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.135907 Apr 20 19:19:36.667876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 153/298] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:36 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:36.704049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:36.704465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:36.713588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.714219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.715192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:36.715755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:36.878917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:36.888190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fabae4a9-b439-42f2-9c66-3ce3973a35bb tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1504 microversion: 2.1 time: 0.309846 Apr 20 19:19:36.888897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 146/299] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:36 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:36.967187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:36.976525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d169ba16-6ab5-48b9-a1d0-168d24ebea58 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.277436 Apr 20 19:19:36.977243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 154/300] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:36 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:37.588669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:37.590582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:37.601622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.602494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.603655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.604433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.679112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:37.680154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:37.688143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.688584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.689447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.689899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.731719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-63c08821-0b6d-4c4f-a85b-599115a276c5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.146872 Apr 20 19:19:37.732436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 147/301] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:37 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:37.818498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-411dc913-6daa-4332-b5dd-4ffd948180da tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.143122 Apr 20 19:19:37.819306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 155/302] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:37 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:37.908767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:37.909964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:37.919127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.919645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.920529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:37.921168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:37.996127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:37.997170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:38.007704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.008558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:38.009789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.010486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:38.382878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:38.392019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f1ee9eed-e142-4356-b748-c8c68ea8802d tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1504 microversion: 2.1 time: 0.488241 Apr 20 19:19:38.392624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 148/303] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:37 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:38.402747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:38.405670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a4fde150-fb3d-49d8-b262-bd164736b1bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.413952 Apr 20 19:19:38.407015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 156/304] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:37 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:38.744675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:38.745721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:38.753968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.754471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:38.755306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.755793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:38.831445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:38.832598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:38.840832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.841275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:38.842168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:38.842660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:41.624894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2da21916-445f-4cee-a1d8-43d64cebd022 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 2.884140 Apr 20 19:19:41.626822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 149/305] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:38 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:41.637309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:41.637866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:41.649726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:41.650429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:41.651413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:41.652228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:41.659800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b44d8555-65da-46f8-b133-adb1c00d2122 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 2.832005 Apr 20 19:19:41.660687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 157/306] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:38 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:41.666656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:41.667444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:41.676811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:41.677320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:41.678214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:41.678707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:42.317768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:42.328500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2d41147d-f667-4ed3-99a4-87cbb0e0767f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.666011 Apr 20 19:19:42.339353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 158/307] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:41 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:42.339626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:42.347118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cdad060b-d1aa-4e3c-80f1-2c059d42419c tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1504 microversion: 2.1 time: 0.718811 Apr 20 19:19:42.347899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 150/308] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:41 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:42.638434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:42.641635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:42.653888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:42.655161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:42.658930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:42.661982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:42.676072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:42.677607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:42.696568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:42.700163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:42.701717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:42.704957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:42.835154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e71ac3a-5a72-413d-95e5-6e56b9ba6319 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.201713 Apr 20 19:19:42.836264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 159/309] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:42 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:42.853661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c9956e35-4b42-4266-b58d-9f5147a4b6ba tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28605 microversion: 2.1 time: 0.183832 Apr 20 19:19:42.854814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 151/310] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:42 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:42.990019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-2d2e240b-52cb-42d3-bed5-8c00bf1287a9 req-206a5f21-0566-445d-8ce5-17dbb8bd1ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1af3b7-2128-458a-ab17-1f0540b79324", "name": "network-vif-deleted", "tag": "fe527323-afc8-4594-99da-d6773e29d93f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:42.992561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:42.992561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:43.006304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2d2e240b-52cb-42d3-bed5-8c00bf1287a9 req-206a5f21-0566-445d-8ce5-17dbb8bd1ae6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.007020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2d2e240b-52cb-42d3-bed5-8c00bf1287a9 req-206a5f21-0566-445d-8ce5-17dbb8bd1ae6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.028270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-2d2e240b-52cb-42d3-bed5-8c00bf1287a9 req-206a5f21-0566-445d-8ce5-17dbb8bd1ae6 service nova] Creating event network-vif-deleted:fe527323-afc8-4594-99da-d6773e29d93f for instance 5d1af3b7-2128-458a-ab17-1f0540b79324 on hv-cinder-78693 Apr 20 19:19:43.034593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-2d2e240b-52cb-42d3-bed5-8c00bf1287a9 req-206a5f21-0566-445d-8ce5-17dbb8bd1ae6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054584 Apr 20 19:19:43.035886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 160/311] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:43.348645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:43.349492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:43.358612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.359091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.360051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.360531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.366036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:43.367008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:43.375890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.376770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.377710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.378464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.464785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.465281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.465870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lazy-loading 'fault' on Instance uuid 5d1af3b7-2128-458a-ab17-1f0540b79324 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:19:43.590494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d34cc538f4d809474e0571b0db346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c847e04a33b45a68c63a63c3ff855fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:43.615191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d59f69ce-0e99-4703-ad98-abe997f3e36a tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 200 len: 1304 microversion: 2.1 time: 0.252640 Apr 20 19:19:43.617644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 161/312] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:43 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 1304 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:43.708260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:43.720577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06beec12-456b-4543-9615-0832bd01af99 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.376575 Apr 20 19:19:43.721531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 152/313] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:43 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:43.847530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:43.848574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:43.858548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.859726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.861246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.862496 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.866188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:43.867159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:43.881545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.882251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:43.883997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:43.885811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.002004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5d661416-0283-45e6-956a-6d6980593482 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.158314 Apr 20 19:19:44.002745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 162/314] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:43 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:44.022103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fed120c6-9c04-4042-9894-d7d0444d025a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 28835 microversion: 2.1 time: 0.159657 Apr 20 19:19:44.023052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 153/315] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:43 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 28835 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:44.062375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c3fa849-3635-491e-b8cc-9908db04da68"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:44.063415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:44.084194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.084773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.085633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.086151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.310853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Invalid volume: volume 1c3fa849-3635-491e-b8cc-9908db04da68 is already attached to instances: 849c1a32-0a61-408c-9cae-f0931eb6b1e3 Apr 20 19:19:44.312678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 400 to user: Invalid volume: volume 1c3fa849-3635-491e-b8cc-9908db04da68 is already attached to instances: 849c1a32-0a61-408c-9cae-f0931eb6b1e3 {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:19:44.313783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f54268ed-fe3f-4cf1-afc4-26abde7554d6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.256473 Apr 20 19:19:44.315067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 163/316] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:19:44 2021] POST /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments => generated 174 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:19:44.507164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:44.507815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:44.517710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.518246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.519126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.519615 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.635658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:44.636213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] [instance: 5d1af3b7-2128-458a-ab17-1f0540b79324] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:44.648332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.649051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.650122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.650743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.711499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] HTTP exception thrown: Instance 5d1af3b7-2128-458a-ab17-1f0540b79324 could not be found. Apr 20 19:19:44.712669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] Returning 404 to user: Instance 5d1af3b7-2128-458a-ab17-1f0540b79324 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:19:44.713915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-deb6c5ff-e5b7-42e1-a30f-13aa093f3fbc tempest-VolumesActionsTest-200683644 tempest-VolumesActionsTest-200683644-project] 10.222.0.48 "GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324" status: 404 len: 111 microversion: 2.1 time: 0.082353 Apr 20 19:19:44.715268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 164/317] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:44 2021] GET /compute/v2.1/servers/5d1af3b7-2128-458a-ab17-1f0540b79324 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:19:44.727922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'services' on Instance uuid 849c1a32-0a61-408c-9cae-f0931eb6b1e3 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:19:44.740607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:44.741429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:44.756928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.757551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:44.760719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:44.762654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:45.020351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:45.033050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3a45c183-0f32-432a-9e58-c6467fe4bd16 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.296530 Apr 20 19:19:45.033863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 165/318] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:44 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:45.039070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:45.040744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:45.049455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:45.050169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:45.051198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:45.051822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:45.052378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-24727460-df14-4228-b29a-3b2a3ace35ab tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments/1c3fa849-3635-491e-b8cc-9908db04da68" status: 202 len: 0 microversion: 2.1 time: 0.549716 Apr 20 19:19:45.053017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 154/319] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:19:44 2021] DELETE /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3/os-volume_attachments/1c3fa849-3635-491e-b8cc-9908db04da68 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:45.075085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:45.076463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:45.096021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:45.096525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:45.097382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:45.098024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:45.196621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-384f0a62-6b92-49c1-9b5c-60b55758bbb3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.161329 Apr 20 19:19:45.198079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 166/320] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:45 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:45.242378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2ad1b0db-086d-4215-83b5-a3f277bb3621 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 30101 microversion: 2.1 time: 0.187733 Apr 20 19:19:45.243999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 155/321] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:45 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 30101 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:45.582811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-315174409", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "caf71d8f-22e3-4252-8fc9-b332e3720796"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:45.732844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] validate_networks() for [('caf71d8f-22e3-4252-8fc9-b332e3720796', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:19:46.055306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:46.056055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:46.065482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.065981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.067459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.068101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.390054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:19:46.390607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:19:46.391222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:19:46.391765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:19:46.392265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:19:46.458740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.459410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.462111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.463067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.478389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:46.490299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0dfd1e25-822d-4dce-bd1d-6f36d8848db0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.439322 Apr 20 19:19:46.491295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 156/322] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:46 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:46.500498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:46.502322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:46.505050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Getting quotas for project 7be22f2bc47d4b77ad6ca95a8e026bbb. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:19:46.511292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.511963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.512909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Getting quotas for user d9684ccb65b641b9b5906114b428ae4a and project 7be22f2bc47d4b77ad6ca95a8e026bbb. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:19:46.513116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.513924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.527262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:19:46.530927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:19:46.609304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2309a126-1ffb-4403-91a2-0836342fd0cd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031062 Apr 20 19:19:46.610350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 167/323] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:19:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:19:46.615523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:46.616673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:46.626635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.627339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.628349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:46.629020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:46.685023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f4b2fab4-f973-45bf-9c02-4278915865f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.192088 Apr 20 19:19:46.689852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 157/324] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:46 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:46.695829 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1b0ca30e-338a-44fd-a252-3369e20a1694 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:46.696599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1b0ca30e-338a-44fd-a252-3369e20a1694 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:46.779001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1b0ca30e-338a-44fd-a252-3369e20a1694 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:46.787574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1b0ca30e-338a-44fd-a252-3369e20a1694 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1218 microversion: 2.1 time: 0.096313 Apr 20 19:19:46.788342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 158/325] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:46 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:46.793480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-545237315", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "a3d56b3d-c47b-49ff-9e13-42db36c3dbd5"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:46.827460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f45638f1-f897-478e-86f9-0272284182d3 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 32430 microversion: 2.1 time: 0.215629 Apr 20 19:19:46.828190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 168/326] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:46 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 32430 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:46.871029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] validate_networks() for [('a3d56b3d-c47b-49ff-9e13-42db36c3dbd5', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:19:47.443520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:19:47.444122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:19:47.444923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:19:47.445517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:19:47.446216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:19:47.457546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.458097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.458975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.459476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.478832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:19:47.483345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Getting quotas for user 825e0fb1ce1741fd9735f09cd3da24b2 and project ad5936ef70be44ac89df14ad4f1d0832. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:19:47.495508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:19:47.498217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:19:47.510094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:47.511176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:47.520791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.521624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.522914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.523386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.550919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d4d9ba51-3221-426b-b11f-a36342dcf9db tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761151 Apr 20 19:19:47.551695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 159/327] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:19:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:19:47.562114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4e9f11cd-5d79-4807-a443-76b96e93d947 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:47.562766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4e9f11cd-5d79-4807-a443-76b96e93d947 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:47.653969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4e9f11cd-5d79-4807-a443-76b96e93d947 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:47.665608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4e9f11cd-5d79-4807-a443-76b96e93d947 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1217 microversion: 2.1 time: 0.107275 Apr 20 19:19:47.667033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 160/328] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:47 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:47.698921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:47.700144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:47.708942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.709460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.710394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.710842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.808905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:47.818211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2d48a323-48aa-4f0c-8f5b-0265b059f663 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.313136 Apr 20 19:19:47.818828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 169/329] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:47 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:47.823514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:47.825324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:47.832243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.832681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.834866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.834866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.964916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:47.973851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-391a29f1-7f25-49a2-8a19-999b4c75a59a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1222 microversion: 2.1 time: 0.153916 Apr 20 19:19:47.974490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 170/330] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:47 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:47.979211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:47.980429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:47.988069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.988565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:47.989383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:47.989932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:49.953636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1085bd7e-4b35-4596-aec2-bfd5b5c1b349 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 33893 microversion: 2.1 time: 1.977693 Apr 20 19:19:49.954756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 171/331] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:47 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 33893 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:49.960668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:49.961503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:49.970833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:49.971334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:49.972178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:49.972670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.010027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-44ca2819-3b62-4c91-8600-644d6686c7f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 2.316015 Apr 20 19:19:50.015980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 161/332] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:47 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:50.023187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:50.024236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:50.033512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.034117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.035076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.035785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.116643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:50.139005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-320775e6-1662-4780-8808-bc0a361696e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1221 microversion: 2.1 time: 0.182640 Apr 20 19:19:50.139752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 172/333] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:49 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:50.152950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:50.153622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:50.163210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.163716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.164713 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.165208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.305575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:50.314921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0a2633d4-8ca9-4bcd-ab18-1cf0fd02d4bc tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1270 microversion: 2.1 time: 0.173136 Apr 20 19:19:50.315545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 173/334] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:50 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:50.333495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:50.343372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6d637afb-7c26-432f-9ac5-f3d204140736 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.325364 Apr 20 19:19:50.344031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 162/335] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:50 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:50.967799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:50.969120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:50.991974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.992489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:50.993457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:50.993859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.023822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:51.025055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:51.049388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.049934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.050800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.051295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.146146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a2c9939f-ac6d-4193-8c17-b72c9363acf7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 34245 microversion: 2.1 time: 0.182509 Apr 20 19:19:51.150921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 174/336] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:50 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 34245 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:51.158198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:51.159224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:51.169764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.170525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.171703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.172387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.203787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d1d9e983-e5d7-47e2-8a78-dce6576723e5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.182665 Apr 20 19:19:51.208321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 163/337] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:51 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:51.336159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:51.337101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:51.361752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.362747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.363864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.364617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.459226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:51.475298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06927884-2b6f-4e12-8425-e258aa14a8ba tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1269 microversion: 2.1 time: 0.322322 Apr 20 19:19:51.478775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 175/338] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:51 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1269 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:51.495962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:51.498942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:51.527434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.527904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.528817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:51.529308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:51.633721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:51.657413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0ccdd964-1c8a-4771-be35-591792d0be64 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1276 microversion: 2.1 time: 0.326505 Apr 20 19:19:51.662869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 164/339] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:51 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:52.135759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:52.148546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8da4061f-1409-422e-9834-300bb99c5457 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.667385 Apr 20 19:19:52.149509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 176/340] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:51 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:52.168558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:52.169811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:52.182204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.182851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.184259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.184841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.217712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:52.219283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:52.231994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.235646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.236721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.237400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.328015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-30cc9192-d76e-46a8-8c70-6cce5cfee0e1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 34704 microversion: 2.1 time: 0.163754 Apr 20 19:19:52.332514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 165/341] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:52 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 34704 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:52.366439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fbc70f99-b06f-433b-a144-a04ba492aade tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 28680 microversion: 2.20 time: 0.153398 Apr 20 19:19:52.371012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 177/342] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:52 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 28680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:52.497222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:52.498048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:52.522832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.523363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.524263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.524768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.682378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:52.683151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:52.709929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.710831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:52.712465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:52.715251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:53.109192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:53.124470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-87bda699-6ba2-4c7f-994d-56a3389f2cde tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1275 microversion: 2.1 time: 0.631702 Apr 20 19:19:53.127011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 166/343] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:52 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1275 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:53.170681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:53.171329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:53.188065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:53.193565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:53.195258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:53.199262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:53.883607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:53.893900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-37293e8c-d0b6-490a-b448-b7ecd733e358 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1502 microversion: 2.1 time: 0.727985 Apr 20 19:19:53.898602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 167/344] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:53 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1502 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:53.906639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:53.917163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:53.924189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:53.928835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9444d617-faea-4f98-a770-9b5e66bf8a44 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 1.251495 Apr 20 19:19:53.937277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 178/345] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:52 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:53.950765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:53.952921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:53.953587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:53.956118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:53.957936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:53.963902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:53.989768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:53.992924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.002918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.005680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.239475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-249cedab-42ad-46a2-a021-18500fd89855 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 35487 microversion: 2.1 time: 0.336600 Apr 20 19:19:54.240206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 168/346] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:53 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 35487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:54.249886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1fe7ea-27a2-40f0-9cae-0e34f901b222"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:54.253722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:54.262123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c3548d60-1ae2-46f0-8640-ea1ba8e5a1b1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 33095 microversion: 2.20 time: 0.323064 Apr 20 19:19:54.262841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 179/347] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:53 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 33095 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:54.272727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:54.273506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:54.296310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.308073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.309027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.309536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.320410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.320846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.321743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.322278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.465425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] HTTP exception thrown: Cannot 'attach_volume' instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 while it is in vm_state rescued Apr 20 19:19:54.466346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Returning 409 to user: Cannot 'attach_volume' instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 while it is in vm_state rescued {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:19:54.467422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f9af9325-7458-413c-8be5-b8c299fdb669 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.226066 Apr 20 19:19:54.468194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 169/348] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:19:54 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments => generated 152 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:19:54.477368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:54.478299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:54.489227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.491084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.492154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.492841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.696192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a1f10ef1-5d4a-4758-8527-d296de70909f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action" status: 202 len: 0 microversion: 2.1 time: 0.222369 Apr 20 19:19:54.700591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 170/349] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:54 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:54.714932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:54.732322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:54.743260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.744190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:54.745078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:54.746589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.041732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:55.060587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-703b9878-fde4-4f1d-a8d2-10df26bec227 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.784184 Apr 20 19:19:55.061329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 180/350] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:54 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:55.085916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:55.086544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:55.121481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.122035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.126234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.127143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.593960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:55.618400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06ee6b25-a0ee-4812-9f28-a0a36694358e tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1510 microversion: 2.1 time: 0.912112 Apr 20 19:19:55.622360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 171/351] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:54 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1510 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:55.635853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-738f0668-49af-43c5-837a-63c684067fcd req-2905eef6-fd0e-48d9-b8bf-263e77f4d2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa214411-492e-4ee0-9679-c3255f6b0f5e", "tag": "6231c497-6c68-4d14-8846-a83561edaf4c"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:55.643799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:55.643799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:55.660561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-738f0668-49af-43c5-837a-63c684067fcd req-2905eef6-fd0e-48d9-b8bf-263e77f4d2a3 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.661719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-738f0668-49af-43c5-837a-63c684067fcd req-2905eef6-fd0e-48d9-b8bf-263e77f4d2a3 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.693637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-738f0668-49af-43c5-837a-63c684067fcd req-2905eef6-fd0e-48d9-b8bf-263e77f4d2a3 service nova] Creating event network-changed:6231c497-6c68-4d14-8846-a83561edaf4c for instance aa214411-492e-4ee0-9679-c3255f6b0f5e on hv-cinder-78693 Apr 20 19:19:55.712244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-738f0668-49af-43c5-837a-63c684067fcd req-2905eef6-fd0e-48d9-b8bf-263e77f4d2a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087269 Apr 20 19:19:55.713360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 172/352] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:55.726157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-649ea367-e23f-445e-83c3-c12cd5494164 req-e2ed940c-357e-4b5b-b1f6-8dc63c083202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505284cb-e5da-4512-9b32-25a518fd82fc", "tag": "87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:55.728384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:19:55.728384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:19:55.751154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:55.751610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-649ea367-e23f-445e-83c3-c12cd5494164 req-e2ed940c-357e-4b5b-b1f6-8dc63c083202 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.755273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-649ea367-e23f-445e-83c3-c12cd5494164 req-e2ed940c-357e-4b5b-b1f6-8dc63c083202 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.763566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5dd4a591-5a35-40db-ab2e-cdd1f9a3575b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.701014 Apr 20 19:19:55.764410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 181/353] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:55 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:55.778862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:55.779995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:55.789714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-649ea367-e23f-445e-83c3-c12cd5494164 req-e2ed940c-357e-4b5b-b1f6-8dc63c083202 service nova] Creating event network-changed:87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3 for instance 505284cb-e5da-4512-9b32-25a518fd82fc on hv-cinder-78693 Apr 20 19:19:55.805300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-649ea367-e23f-445e-83c3-c12cd5494164 req-e2ed940c-357e-4b5b-b1f6-8dc63c083202 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090044 Apr 20 19:19:55.806257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 173/354] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:19:55.812258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:55.813473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:55.819580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.820057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.821132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.822186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.836149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.836670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.837557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:55.838082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:55.982642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-aa49c869-9efd-49a4-80c9-c242df0d735d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 36213 microversion: 2.1 time: 0.214251 Apr 20 19:19:55.988943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4e4c51ce-4ef8-4891-8b9a-d30064e48986 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 34726 microversion: 2.20 time: 0.181252 Apr 20 19:19:55.989345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 182/355] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:55 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 36213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:55.990247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 174/356] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:55 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 34726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:56.081318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:56.082520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:56.100636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.101475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:56.102548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.105383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:56.626055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:56.641881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:56.642751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:56.661448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-59119d74-fe2e-4d61-b9f9-fc098ecb74b6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.584415 Apr 20 19:19:56.662136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 183/357] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:56 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:56.668131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.668613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:56.669876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.670514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:56.782283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:56.783162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:56.798686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.802996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:56.804012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:56.805066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:57.645858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:57.662394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ae3ea952-cd36-43e3-9902-d336779eff15 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1510 microversion: 2.1 time: 1.024405 Apr 20 19:19:57.663000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 175/358] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:56 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1510 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:57.688170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:57.690742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:57.709434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:57.711021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:57.712869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:57.713747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:57.919648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5a834715-726a-46e2-b1a5-1bad3600ae0f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 37413 microversion: 2.1 time: 0.250924 Apr 20 19:19:57.923190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 176/359] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:57 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 37413 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:57.937170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:57.939838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:57.941864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:57.951294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fd80c6b8-8eb4-4fc2-afe8-ab2729550ef8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 1.173053 Apr 20 19:19:57.951904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 184/360] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:56 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:57.966628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:57.967577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:57.968115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:57.970989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:57.971525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:57.973624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:57.996262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:57.997430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.001904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.002707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.229229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a206dac-369f-495c-9f5e-f6155fa63bcb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 36593 microversion: 2.20 time: 0.302783 Apr 20 19:19:58.231756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 177/361] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:57 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 36593 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:19:58.346285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:58.363784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4c42a1c7-18e8-403b-9bb8-1afe1d535b80 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.401019 Apr 20 19:19:58.364427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 185/362] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:57 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:58.682875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:58.684298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:58.693899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.694439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.695279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.695758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.934469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:58.935580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:58.948538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:58.950857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.951742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.952854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.953745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.964116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9ee748ce-135e-4a78-9766-ac4e91be1d88 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1510 microversion: 2.1 time: 0.284668 Apr 20 19:19:58.967946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 178/363] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:58 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:58.975897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:58.976842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:58.986627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.987523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:58.988586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:58.989292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.099943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d3ea5c70-371e-455b-9b20-f12868038084 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 37908 microversion: 2.1 time: 0.170317 Apr 20 19:19:59.100636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 186/364] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:19:58 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 37908 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:19:59.243853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:19:59.246591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:59.268172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.268674 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.269879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.276270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.343862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:59.355174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6fbae76f-cd38-4446-83e7-73c80b57b83e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.386022 Apr 20 19:19:59.368001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 179/365] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:58 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:19:59.383616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:59.384651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:59.395184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.395824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.396897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.397466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.510601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9a6cea48-c095-40cf-9a83-a79892bec100 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 36938 microversion: 2.20 time: 0.271292 Apr 20 19:19:59.511890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 187/366] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:19:59 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 36938 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:19:59.643762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:19:59.652909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3f44a1dc-0f6d-4e3b-b4f6-451043718e8e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.274424 Apr 20 19:19:59.653576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 180/367] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:59 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:19:59.986301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:19:59.987070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:19:59.996126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.996632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:19:59.997467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:19:59.997994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.113467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:00.114669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:00.123004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.123517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.124365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.124947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.237620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:00.246688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9faaa5aa-7857-4b28-a52a-e3de2ff93354 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1516 microversion: 2.1 time: 0.264993 Apr 20 19:20:00.247302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 188/368] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:19:59 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:00.251961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c35b430e-64ad-412c-8cae-d50aece8b6fb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 38041 microversion: 2.1 time: 0.142926 Apr 20 19:20:00.252980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 181/369] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:00 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 38041 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:20:00.375083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:00.375666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:00.383900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.384404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.385276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.385761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.524944 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:00.526342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:00.536830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.537349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.538239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.538735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.628100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:00.657527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0cf5c4c7-038e-4a06-a539-b2fb89cfe296 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 37212 microversion: 2.20 time: 0.136960 Apr 20 19:20:00.663481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 182/370] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:00 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 37212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:00.672220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:00.673127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:00.676526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-545fb413-6465-490f-ad7f-e7a24db870c3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.305414 Apr 20 19:20:00.686585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 189/371] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:00 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:00.686711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.686711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.686711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:00.686711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:00.913169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:00.922390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e579a578-70b0-47de-80f8-e4456df6cc95 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.254865 Apr 20 19:20:00.923187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 183/372] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:00 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:01.265628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:01.266772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:01.274690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.275188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.276056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.276540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.400575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b5917847-d855-4ee4-8ae0-862cae209045 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 38041 microversion: 2.1 time: 0.139606 Apr 20 19:20:01.402365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 190/373] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:01 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 38041 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:20:01.671476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:01.672621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:01.681252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.681847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.682762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.683324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.695291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:01.696231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:01.705329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.708947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.709813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.710363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.952619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:01.962372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-99dce7cc-cd54-4548-a9df-f9f03dc742be tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.271670 Apr 20 19:20:01.963377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 191/374] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:01 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:01.968806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:01.969744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:01.982546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.983062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:01.983864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:01.984515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:02.221407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:02.230629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6fa26288-9038-4312-8e59-c1c749815976 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1516 microversion: 2.1 time: 0.266029 Apr 20 19:20:02.231252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 192/375] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:01 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:02.235893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:02.236556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:02.244630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:02.245112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:02.246015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:02.246431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:02.476900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:02.486375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d06b772e-4307-4d2f-904d-78664af94fc9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.253982 Apr 20 19:20:02.487007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 193/376] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:02 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:02.491939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed5bb8c0-5103-4544-8b75-7cd8ec35e371"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:02.493201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:02.501056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:02.501565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:02.502457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:02.502954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.201796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-439cd0bb-5525-4318-8b1a-63d2092cef1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 38083 microversion: 2.20 time: 3.533763 Apr 20 19:20:05.202949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 184/377] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:01 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 38083 bytes in 3537 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:20:05.211968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:05.214511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:05.227330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.227846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.228735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.229266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.340739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-09343195-fe3b-455d-8289-6597223ff604 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 200 len: 38169 microversion: 2.1 time: 0.135474 Apr 20 19:20:05.341907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 185/378] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:05 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 38169 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:20:05.347711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:05.348937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:05.358039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.358556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.359415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.359923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.380963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-68046d7f-295b-4fc6-a70a-f6a70f164e73 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.892143 Apr 20 19:20:05.386255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 194/379] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:20:02 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments => generated 194 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:05.407123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:05.410387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:05.427336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.430477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.431535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.433925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.806321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:05.815281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:05.819966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-30352420-bdb9-411c-b957-b0ab8e72aa78 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.474950 Apr 20 19:20:05.820638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 186/380] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:05 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:05.826269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1b69595b-6d70-431d-997f-e5866d6f296d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.442239 Apr 20 19:20:05.827115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 195/381] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:05 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:05.827366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:05.828481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:05.836521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.837077 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.837874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:05.838480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:05.910314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d86f0443-633d-4454-b5f3-943617f29885 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/ips" status: 200 len: 146 microversion: 2.1 time: 0.088485 Apr 20 19:20:05.910951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 187/382] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:20:05 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/ips => generated 146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:06.214411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:06.215595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:06.224229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.224755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.225744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.226319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.344402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4ae039e3-cee1-4477-b5a6-c67dbe4852f6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 38137 microversion: 2.20 time: 0.134119 Apr 20 19:20:06.345114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 196/383] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:06 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 38137 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:06.837724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:06.838445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:06.847585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.848058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:06.848162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.848974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.849703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.850599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:06.860763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.861389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.862372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.863265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:07.153261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:07.168457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-12ec3ea9-8ecb-46bf-a2a3-c8dea6af207f tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.334902 Apr 20 19:20:07.169287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 188/384] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:06 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:07.250477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:07.260735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-310fd411-07c7-494b-9aec-4ec5109ebca0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.417524 Apr 20 19:20:07.271633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 197/385] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:06 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:07.357533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:07.358610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:07.366942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:07.367439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:07.368280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:07.368787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:07.482056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ed692b81-ce28-4b49-92f7-992a27fd4acc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 38137 microversion: 2.20 time: 0.128356 Apr 20 19:20:07.482772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 189/386] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:07 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 38137 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:08.186515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:08.187200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:08.195347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.195847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.196820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.206533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.280038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:08.281513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:08.293486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.294238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.295276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.295948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.629721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:08.634729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:08.642449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-91b4e6a8-1750-4f41-aa07-0aaf668c6c91 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.367551 Apr 20 19:20:08.643577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b35e6777-d3fb-43ea-8d86-a8aeca20dc56 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.461131 Apr 20 19:20:08.644587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 198/387] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:08 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:08.650253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:08.651499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:08.653242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 190/388] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:08 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:08.660868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.661423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.662295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.662787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.782491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-491ab715-28da-4d16-bc91-aea360abbf3a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 200 len: 38275 microversion: 2.20 time: 0.135768 Apr 20 19:20:08.783228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 199/389] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:08 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 38275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:08.794106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:08.794657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:08.803564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.804064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.804913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:08.805438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:08.870701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6457d94b-63ce-4f8a-a42b-cf148e7b6fdf tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/ips" status: 200 len: 153 microversion: 2.20 time: 0.080607 Apr 20 19:20:08.871254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 191/390] 10.222.0.48 () {60 vars in 1279 bytes} [Tue Apr 20 19:20:08 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/ips => generated 153 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:20:09.166810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd164fc-b647-4606-8d08-65427d5d903e"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:09.168434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:09.177538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.178254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:09.179278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.179912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:09.661319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:09.662064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:09.675529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.679394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:09.680439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.681214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:09.797852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-af2089da-356f-4bce-97a9-3d82a8476d15 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635118 Apr 20 19:20:09.818766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 200/391] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:20:09 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:09.847034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:09.849749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:09.877136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.877648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:09.878587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:09.881363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:10.167353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:10.191656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c3e068ba-1335-4654-9ef4-bfafe48175c0 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.526079 Apr 20 19:20:10.192508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 192/392] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:09 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:10.343760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:10.355494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-94e66421-d6b5-42fd-996d-68458e1194e9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.533200 Apr 20 19:20:10.356152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 201/393] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:09 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:11.211099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:11.211901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:11.232176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.232683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:11.233540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.234062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:11.373890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:11.376125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:11.397181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.399144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:11.400231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.401525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:11.676848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:11.691931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ba68989-b0fb-4ff9-b34f-679d4ba8414c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.321186 Apr 20 19:20:11.691931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 202/394] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:11 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:11.923501 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:11.938181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f151a65b-0083-4b84-bc4d-6908a744d663 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.730609 Apr 20 19:20:11.939211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 193/395] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:11 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:11.953759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:11.954406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:11.962735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.963239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:11.964098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:11.964586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:12.060697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lazy-loading 'flavor' on Instance uuid b4274f79-46b3-473f-b889-4961413e29ce {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:20:12.507369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e284f94f-6176-41c9-b156-8b9d1caa4730 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 202 len: 0 microversion: 2.20 time: 0.567622 Apr 20 19:20:12.511824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 203/396] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:20:11 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:20:12.519100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:12.520073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:12.532983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:12.533920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:12.535314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:12.535992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:12.708971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:12.710870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:12.724935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:12.725778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:12.726906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:12.727611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:12.972521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:12.985261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:12.986972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:12.988253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7f73fd8a-9044-4ed2-8cd4-c0970b82fb95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.473957 Apr 20 19:20:12.989053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 194/397] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:12 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:13.001223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:13.011445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:13.024107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:13.024639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:13.025472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:13.029274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:13.149284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:13.167307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-46e385b4-5b2e-47ba-8fb1-9a65c1a1a34c tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 0.462727 Apr 20 19:20:13.167958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 204/398] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:12 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:13.324622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:13.343292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6654fb77-96f9-4dd6-ba91-9509857cf2d2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.353331 Apr 20 19:20:13.346202 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 195/399] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:12 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:13.865199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:13.867012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:13.875849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:13.876290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:13.877112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:13.877913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:13.972820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'flavor' on Instance uuid eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:20:14.004087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-09615e30-945a-430e-8f8e-90a9bc11318e req-9bd4b5a8-ff0d-4f3b-950f-f8c847776a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505284cb-e5da-4512-9b32-25a518fd82fc", "name": "network-vif-plugged", "status": "completed", "tag": "87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:14.006652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:20:14.006652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:20:14.026177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-09615e30-945a-430e-8f8e-90a9bc11318e req-9bd4b5a8-ff0d-4f3b-950f-f8c847776a02 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.032342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-09615e30-945a-430e-8f8e-90a9bc11318e req-9bd4b5a8-ff0d-4f3b-950f-f8c847776a02 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.063662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-09615e30-945a-430e-8f8e-90a9bc11318e req-9bd4b5a8-ff0d-4f3b-950f-f8c847776a02 service nova] Creating event network-vif-plugged:87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3 for instance 505284cb-e5da-4512-9b32-25a518fd82fc on hv-cinder-78693 Apr 20 19:20:14.069276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-09615e30-945a-430e-8f8e-90a9bc11318e req-9bd4b5a8-ff0d-4f3b-950f-f8c847776a02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078124 Apr 20 19:20:14.071027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 196/400] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:14.078082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:14.079261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:14.091565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.092373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.094758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.095679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.500139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9f1f9e3c-806f-4bac-8186-85b214e78630 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action" status: 200 len: 32 microversion: 2.1 time: 0.638438 Apr 20 19:20:14.501866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 205/401] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:13 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action => generated 32 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:20:14.522385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:14.525292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:14.570663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.571150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.572068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.572577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.797005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:14.822440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:14.822440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:14.823611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e786e99e-300e-4962-bf10-ab053cea860b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.751129 Apr 20 19:20:14.824159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 197/402] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:14 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:14.841266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:14.847679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:14.869903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.870529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:14.870926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:14.871389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:15.573294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:15.588790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4914de16-8a7e-43c5-83f3-9459f7073ce3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1317 microversion: 2.1 time: 1.085331 Apr 20 19:20:15.589648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 206/403] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:14 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:15.599001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:15.601910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:15.605399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:15.616991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:15.618469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:15.620150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:15.620449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0fbdb68d-8e5d-429e-8180-353f30c46a11 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.795132 Apr 20 19:20:15.621112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 198/404] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:14 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:15.621822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:15.844982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:15.845862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:15.862369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:15.868466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:15.869402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:15.869939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:16.536283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:16.546919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7fcebab2-e04f-4616-a00c-89cecd10b9f5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.952532 Apr 20 19:20:16.548298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 207/405] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:15 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:16.554099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-55b1706c-23e8-496f-bb9c-bba1699063b1 req-9de16aed-a914-4264-8850-747aee329900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa214411-492e-4ee0-9679-c3255f6b0f5e", "name": "network-vif-plugged", "status": "completed", "tag": "6231c497-6c68-4d14-8846-a83561edaf4c"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:16.556259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:20:16.556259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:20:16.566507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-55b1706c-23e8-496f-bb9c-bba1699063b1 req-9de16aed-a914-4264-8850-747aee329900 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:16.567302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-55b1706c-23e8-496f-bb9c-bba1699063b1 req-9de16aed-a914-4264-8850-747aee329900 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:16.587077 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-55b1706c-23e8-496f-bb9c-bba1699063b1 req-9de16aed-a914-4264-8850-747aee329900 service nova] Creating event network-vif-plugged:6231c497-6c68-4d14-8846-a83561edaf4c for instance aa214411-492e-4ee0-9679-c3255f6b0f5e on hv-cinder-78693 Apr 20 19:20:16.592706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-55b1706c-23e8-496f-bb9c-bba1699063b1 req-9de16aed-a914-4264-8850-747aee329900 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042930 Apr 20 19:20:16.594181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 208/406] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:20:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:16.612719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:16.614344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:16.624550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:16.625325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:16.626366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:16.627004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:16.694845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:16.705133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:16.706978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:16.708625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a4aaf00e-3fd1-4169-a63b-bc3d1a0bd8d6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.869418 Apr 20 19:20:16.710554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 199/407] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:15 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:16.731084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:16.748692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:16.776673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:16.776673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:16.776673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:16.776673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:17.145102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:17.156125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4bb6db04-7e85-4824-a9e3-07b23f5207d4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1507 microversion: 2.1 time: 0.550612 Apr 20 19:20:17.165617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 209/408] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:16 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:17.320711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:17.335355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-128e6ed4-4a19-4c25-93ac-f8260d9c0435 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.608050 Apr 20 19:20:17.342622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 200/409] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:16 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:17.566883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:17.567708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:17.582907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:17.583666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:17.586067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:17.586756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:17.728988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:17.729576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:17.762583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:17.763098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:17.763967 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:17.764466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:18.259846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:18.277077 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:18.278918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:18.289953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4dc34a37-3c49-4f13-8d38-b6556098b664 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.555925 Apr 20 19:20:18.290886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 201/410] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:17 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:18.360382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:18.361255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:18.378075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:18.378905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:18.379973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:18.383785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:18.400304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:18.410660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a345c912-5e14-419c-8139-70eda9f250be tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.847904 Apr 20 19:20:18.411959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 210/411] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:17 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:18.675145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:18.687284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e373d7f8-07b0-4534-9cdd-c7645f5af2d1 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1318 microversion: 2.1 time: 0.331146 Apr 20 19:20:18.698588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 202/412] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:18 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:19.116163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cf0b42a-2c05-4b60-bc4f-4e25cda2c42d"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:19.117477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:19.131529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.136062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:19.137413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.137531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:19.311448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:19.312960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:19.346318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.347103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:19.348626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.353458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:19.749225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:19.761220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:19.768291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:19.772955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d003d256-fe57-44be-a728-5e615ffedc07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.465892 Apr 20 19:20:19.773617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 203/413] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:19 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:19.819107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:19.823463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:19.846785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.848829 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:19.849990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:19.851507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:20.114880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-994aabbf-696a-40e3-8a5f-b0fbf7edb07e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "POST /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.002689 Apr 20 19:20:20.119482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 211/414] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:20:19 2021] POST /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc/os-volume_attachments => generated 194 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:20.134305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:20.139088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:20.159825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:20.162365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:20.166988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:20.167892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:20.296724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:20.320870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-76877510-8f54-4d86-98ce-53f114b9f106 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.513149 Apr 20 19:20:20.321505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 204/415] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:19 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:20.499102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:20.509678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0e4f15b4-21f6-46cd-ae6b-be2b247dd424 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1507 microversion: 2.1 time: 0.388025 Apr 20 19:20:20.510375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 212/416] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:20 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:20.800307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:20.800975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:20.810715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:20.811211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:20.812620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:20.813654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.076864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:21.088495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:21.090464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:21.091916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e010ae37-42fc-4832-aff9-f3619694c2c0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.301878 Apr 20 19:20:21.096679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 205/417] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:20 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:21.340285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:21.341665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:21.351645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:21.352415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.353443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:21.354165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.442193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c27af716-4f84-4b68-adc5-39551cddcd52 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:21.450854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c27af716-4f84-4b68-adc5-39551cddcd52 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:21.451922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c27af716-4f84-4b68-adc5-39551cddcd52 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.530138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c27af716-4f84-4b68-adc5-39551cddcd52 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Going to try to stop instance {{(pid=100515) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 19:20:21.592238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:21.603043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7edc3a0f-6aa3-407c-90e4-be8ba70a3d8f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.266081 Apr 20 19:20:21.603852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 213/418] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:21 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:21.653080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c27af716-4f84-4b68-adc5-39551cddcd52 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 202 len: 0 microversion: 2.1 time: 0.214899 Apr 20 19:20:21.657185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 206/419] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:21 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:20:21.662931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:21.663576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:21.679510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:21.680093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.681097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:21.681610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:21.923273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:21.933488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-890ff865-ecdd-4f16-999e-c5f02e1e5a3d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.274906 Apr 20 19:20:21.934266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 214/420] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:21 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:22.113276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:22.114086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:22.122466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.122964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:22.124310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.124949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:22.410879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:22.445151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:22.446904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:22.448684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7a6d7d06-c67a-48db-9ae1-dfacfb7f8da2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.340495 Apr 20 19:20:22.458213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 207/421] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:22 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:22.622190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:22.623167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:22.632472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.633189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:22.634284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.634987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:22.900020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:22.911962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b0385358-0f11-4efe-ae24-39993ce40ab5 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.294044 Apr 20 19:20:22.913350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 215/422] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:22 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:22.952597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:22.953253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:22.961765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.962657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:22.963728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:22.964420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:23.196197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:23.207038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-53940a6d-d42c-4273-957f-7c9b586e1fa8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.258452 Apr 20 19:20:23.218211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 208/423] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:22 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:23.469098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:23.470431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:23.479185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:23.479683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:23.480514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:23.481214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:23.708402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:23.718453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:23.720249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:23.721587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5c36c3c-0fb4-48d3-8899-545fc7c983c7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.256917 Apr 20 19:20:23.722313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 216/424] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:23 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:23.930948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:23.932019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:23.942174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:23.944377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:23.945449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:23.946186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:24.227606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:24.231185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:24.248958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:24.249438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:24.250537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:24.251172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:24.588269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:24.608992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06cfc0bf-bda0-4af6-a7d8-92920e3d7bdb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.681978 Apr 20 19:20:24.615598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 209/425] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:23 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:24.747426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:24.748243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:24.757100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:24.757620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:24.758560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:24.759091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:24.861497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:24.873700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a9c9ffe-020f-426f-97b5-ea153b33dfe6 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.651588 Apr 20 19:20:24.874506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:24 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:25.361261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:25.371788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:25.373589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:25.374869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-876ff5f3-f19d-458a-b480-a1cd9bd873e3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.632820 Apr 20 19:20:25.375429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 210/427] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:24 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:25.635162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:25.636929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:25.648693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:25.650319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:25.651693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:25.652427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:25.894707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:25.895671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:25.904889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:25.905407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:25.906338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:25.907049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:26.946531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:26.963469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c0c1c74-043d-4f06-908c-8a46b8708657 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 1.333929 Apr 20 19:20:26.964284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 218/428] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:25 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:26.980439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:26.982049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:26.998436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:27.000790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:27.004383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:27.005238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:27.153806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:27.167788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8f4b5cc5-a455-48ef-b1c5-dd033bd2f018 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 1.278823 Apr 20 19:20:27.182984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:25 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:27.483924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:27.494678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:27.504187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:27.505595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21c311cd-7a8f-4706-9c14-d87db962dfff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.540058 Apr 20 19:20:27.506306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 219/430] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:26 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:27.985712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:27.987143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:27.997171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:27.997946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:27.999258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:27.999735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:28.193267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:28.194236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:28.213478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:28.214285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:28.216732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:28.220665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:28.388605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:28.409478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c57a681a-81ba-41ae-a524-f549adb8736a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.428571 Apr 20 19:20:28.418349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 212/431] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:27 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:28.526154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:28.526998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:28.555532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:28.556088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:28.556989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:28.557495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:28.781214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:28.806966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-25112ec5-041a-4de6-8447-527486ffadb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.620020 Apr 20 19:20:28.811972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 220/432] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:28 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:29.177894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:29.188506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:29.190180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:29.191786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-82f46d30-ba05-4658-ba83-73b1030b0681 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.670575 Apr 20 19:20:29.192761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 213/433] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:28 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:29.235543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:29.236097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:29.244563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.245074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:29.245937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.246624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:29.436620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:29.437269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:29.449034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'services' on Instance uuid 505284cb-e5da-4512-9b32-25a518fd82fc {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:20:29.451881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.452575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:29.453600 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.454274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:29.837277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:29.850244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cec0bb00-813e-439a-b485-21f57373624c tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.416016 Apr 20 19:20:29.861286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ef5a3f69-31ac-49cb-aef7-7e4d76ce46ce tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc/os-volume_attachments/8cf0b42a-2c05-4b60-bc4f-4e25cda2c42d" status: 202 len: 0 microversion: 2.1 time: 0.628198 Apr 20 19:20:29.861286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 221/434] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:20:29 2021] DELETE /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc/os-volume_attachments/8cf0b42a-2c05-4b60-bc4f-4e25cda2c42d => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:29.864842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 214/435] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:29 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:29.886050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:29.889083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:29.916800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.917302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:29.918190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:29.918685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:30.211736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:30.212706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:30.238932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:30.239486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:30.240337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:30.240833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:30.362350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:30.376689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0c51ec1f-c272-41fb-ab7c-2edbc10bd923 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.513585 Apr 20 19:20:30.377544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 222/436] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:29 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:30.563062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:30.573334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:30.575065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:30.576271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-29e9ac5d-6749-4b7c-bf6b-7da1472b9a4c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.368784 Apr 20 19:20:30.576866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 215/437] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:30 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:30.871462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:30.872135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:30.880334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:30.880846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:30.881694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:30.882234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:31.112467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:31.122893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b3989220-4686-43ed-8ab4-5cba2c0ad2a1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.257910 Apr 20 19:20:31.123517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 223/438] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:30 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:31.395446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:31.396123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:31.404838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:31.405484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:31.406619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:31.407235 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:31.596381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:31.597848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:31.612121 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:31.613008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:31.614125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:31.614775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:31.748236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:31.759633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-36a4cd37-f275-4d64-9825-1e7029d447e2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.368419 Apr 20 19:20:31.761171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 216/439] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:31 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:32.031107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:32.041256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:32.042943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:32.044228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c96d03b8-2c6e-439c-b243-00c668e10444 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.452392 Apr 20 19:20:32.045423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 224/440] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:31 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:20:32.146775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:32.148114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:32.161178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:32.162084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:32.163863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:32.164578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:32.524997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:32.536474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-66de91fe-8bff-464c-b4f8-1eddfb4995bc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.394595 Apr 20 19:20:32.537624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 217/441] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:32 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:32.780432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:32.781520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:32.791535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:32.792452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:32.793383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:32.793940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.040906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:33.051149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d1290efa-622e-48f4-9c1f-5bb28d7c155c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.275414 Apr 20 19:20:33.068712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:33.069689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:33.075322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 225/442] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:32 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:33.079300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.080376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.081474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.082709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.369357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:33.378903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:33.380620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:33.381926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-90d43675-0ae4-41f2-97c0-a3f1aba30d07 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.318148 Apr 20 19:20:33.382534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 218/443] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:33 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:33.554781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:33.555432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:33.566717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.568018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.569462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.570137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.839816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:33.869022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31f9989f-5477-4d31-b1dc-c084a259931b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.308798 Apr 20 19:20:33.869022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 226/444] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:33 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:33.953210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:33.953950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:33.978628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.983923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:33.988194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:33.988763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.071355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:34.072510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:34.102302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.105591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.107645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.109636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.197390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:20:34.451903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b8d677a9-4b90-4ada-84f9-b26976219217 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 204 len: 0 microversion: 2.1 time: 0.511753 Apr 20 19:20:34.453808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 219/445] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:20:33 2021] DELETE /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:20:34.462769 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:34.473807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:34.481649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:34.487414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-419e30dd-1f19-4fee-8109-ec12c11a5ede tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.421252 Apr 20 19:20:34.492016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 227/446] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:34 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:34.497414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.498242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.499271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.499927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.505568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:34.506626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:34.522562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.523457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.526893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.527952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.880692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:34.898911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-42209c76-e320-45fa-9b19-7fd3b0eca605 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1513 microversion: 2.1 time: 0.405466 Apr 20 19:20:34.900942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 228/447] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:34 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:34.907357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:34.909357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:34.920136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:34.922854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.923581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.925244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:34.926148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:34.936696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:34.940403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:34.941899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3f453126-63ca-4ca5-8d08-f60f7d1b51ff tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1743 microversion: 2.20 time: 0.485996 Apr 20 19:20:34.945085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 220/448] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:34 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1743 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:35.225392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:35.247784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a41d2c48-af2b-4603-b9b6-4be3c26fdc47 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.345218 Apr 20 19:20:35.254641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 229/449] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:34 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:35.509015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:35.510293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:35.522324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:35.523004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:35.523973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:35.524810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:35.919625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:35.920455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:35.934783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:35.935295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:35.936152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:35.936620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:36.035821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:36.046734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-41a95f0d-1109-439d-bd5f-135ccab2e448 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1724 microversion: 2.1 time: 0.540972 Apr 20 19:20:36.047394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 221/450] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:35 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1724 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:36.065371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:36.082378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:36.115062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:36.115574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:36.116442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:36.116939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:36.729554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:36.741541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:36.750340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:36.763949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2306b939-745c-4ef8-909e-c7546d536bba tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1743 microversion: 2.20 time: 0.714927 Apr 20 19:20:36.795355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 222/451] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:36 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1743 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:36.801337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:36.802219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:36.811341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:36.812127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:36.813170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:36.815755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:37.883335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:37.900263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-511aee40-e0fd-435f-90c4-3b9dff39e6b4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1513 microversion: 2.1 time: 1.984452 Apr 20 19:20:37.909374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 230/452] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:35 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1513 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:37.921469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:37.937947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:37.954807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:37.958437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:37.959563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:37.961424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:39.092985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:39.117561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-03cf917c-7949-4f5f-abd6-26ab692cd120 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 2.320622 Apr 20 19:20:39.119128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 223/453] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:36 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:39.129337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:39.132512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:39.175961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:39.176895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:39.178271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:39.179107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:39.451126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:39.468940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6e9e4360-e07f-4a17-ae0f-59591beda4dc tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1701 microversion: 2.1 time: 1.558169 Apr 20 19:20:39.469990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 231/454] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:37 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1701 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:39.481861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:39.483050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:39.505710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:39.508238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:39.510034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:39.514136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:40.322180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:40.340004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6de6907a-ab76-4723-9f36-6193b21df6cf tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 200 len: 1471 microversion: 2.1 time: 0.868600 Apr 20 19:20:40.343445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 232/455] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:39 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 1471 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:40.367738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1116c42f-bf14-41bc-9c83-8585848383df tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:40.407046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1116c42f-bf14-41bc-9c83-8585848383df tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:40.410513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1116c42f-bf14-41bc-9c83-8585848383df tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:40.557546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1116c42f-bf14-41bc-9c83-8585848383df tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Going to try to start instance {{(pid=100514) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 19:20:40.907274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1116c42f-bf14-41bc-9c83-8585848383df tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 202 len: 0 microversion: 2.1 time: 0.559302 Apr 20 19:20:40.909353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 233/456] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:40 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:40.922022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:40.925269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:40.946992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:40.948264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:40.950427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:40.952138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:41.421209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:41.465931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:41.468139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:41.473406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4374c125-8666-4b38-a8c1-0644620196f0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 2.352995 Apr 20 19:20:41.482637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 224/457] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:39 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:41.490051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-626c1420-7c5d-404e-a780-9c8943ecfcf9 req-2c362f25-6dac-4c65-805f-4a5bdb603fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505284cb-e5da-4512-9b32-25a518fd82fc", "name": "network-vif-deleted", "tag": "87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:41.506224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:20:41.506224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:20:41.530433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-626c1420-7c5d-404e-a780-9c8943ecfcf9 req-2c362f25-6dac-4c65-805f-4a5bdb603fec service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:41.531186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-626c1420-7c5d-404e-a780-9c8943ecfcf9 req-2c362f25-6dac-4c65-805f-4a5bdb603fec service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:41.605905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-626c1420-7c5d-404e-a780-9c8943ecfcf9 req-2c362f25-6dac-4c65-805f-4a5bdb603fec service nova] Creating event network-vif-deleted:87ec89bc-ae9b-4bdf-a1ee-de08cf1abea3 for instance 505284cb-e5da-4512-9b32-25a518fd82fc on hv-cinder-78693 Apr 20 19:20:41.615626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-626c1420-7c5d-404e-a780-9c8943ecfcf9 req-2c362f25-6dac-4c65-805f-4a5bdb603fec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130786 Apr 20 19:20:41.627180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 225/458] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:41.633308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:41.653960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:41.675027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:41.676272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:41.677381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:41.678120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:41.827842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:41.845277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-afd99c35-e007-4265-be80-652b02300472 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.934331 Apr 20 19:20:41.848981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 234/459] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:40 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:41.861971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:41.867270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 505284cb-e5da-4512-9b32-25a518fd82fc] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:41.889152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:41.892667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:41.894386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:41.897292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:42.015897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Instance 505284cb-e5da-4512-9b32-25a518fd82fc could not be found. Apr 20 19:20:42.016839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 404 to user: Instance 505284cb-e5da-4512-9b32-25a518fd82fc could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:20:42.018214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ba6fe057-a47e-4283-8cd7-d25148648899 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc" status: 404 len: 111 microversion: 2.1 time: 0.166074 Apr 20 19:20:42.019007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 235/460] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:41 2021] GET /compute/v2.1/servers/505284cb-e5da-4512-9b32-25a518fd82fc => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:20:42.093380 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-1484ab1e-1d80-4811-94f5-177f4ba010e4 req-5d65df90-20d7-4750-ab37-038c47e9a70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "name": "network-vif-plugged", "status": "completed", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:42.096290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:20:42.096290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:20:42.129186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-1484ab1e-1d80-4811-94f5-177f4ba010e4 req-5d65df90-20d7-4750-ab37-038c47e9a70d service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:42.137654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-1484ab1e-1d80-4811-94f5-177f4ba010e4 req-5d65df90-20d7-4750-ab37-038c47e9a70d service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:42.205915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-1484ab1e-1d80-4811-94f5-177f4ba010e4 req-5d65df90-20d7-4750-ab37-038c47e9a70d service nova] Creating event network-vif-plugged:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:20:42.225488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-1484ab1e-1d80-4811-94f5-177f4ba010e4 req-5d65df90-20d7-4750-ab37-038c47e9a70d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132624 Apr 20 19:20:42.226721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 236/461] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:20:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:20:42.502006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:42.502897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:42.520638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:42.522319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:42.524280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:42.525041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:43.823384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:43.839229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-db07caee-fda1-432d-b9a5-e91e16374e5b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1710 microversion: 2.1 time: 2.210406 Apr 20 19:20:43.840158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 226/462] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:41 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1710 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:43.845205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:43.846541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:43.859634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:43.860487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:43.861520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:43.862278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:44.164812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:44.183441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:44.185454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:44.186959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f5cccef8-310a-44e9-966a-c092954528aa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 1.689732 Apr 20 19:20:44.199260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 237/463] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:42 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:44.205139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:44.205997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:44.220543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:44.221497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:44.222610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:44.223292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:44.324191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:20:44.704079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-98dd8860-4c2b-4fe9-87be-ff66afbd54a9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 204 len: 0 microversion: 2.1 time: 0.502901 Apr 20 19:20:44.704912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 238/464] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:20:44 2021] DELETE /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:20:44.714449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "986387be-ef68-452d-a851-2a8ac63822ff", "device": "/dev/sdb"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:44.716732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:44.726380 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:44.726887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:44.727736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:44.728221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:45.320999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-459a670b-bf21-4631-990a-d1c1fe513f80 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "POST /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613939 Apr 20 19:20:45.322039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 239/465] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:20:44 2021] POST /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:45.340871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:45.341658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:45.345905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:45.365489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:45.366024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:45.368056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-210f440e-a197-4a2f-a0cb-42bf418eeffd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 1.526575 Apr 20 19:20:45.370214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:45.370739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:45.374520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 227/466] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:43 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:45.395019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:45.398415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:45.409157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:45.410034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:45.411896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:45.412606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:46.644245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:46.679473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bc10ba90-9a35-4a31-bf7f-2779f4b363c4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1710 microversion: 2.1 time: 1.303483 Apr 20 19:20:46.687134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 228/467] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:45 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1710 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:46.695015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:46.699173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:46.719805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:46.722143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:46.723191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:46.727317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:47.815007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:47.834738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-94affbd7-3410-4eee-8d19-9af70088b584 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1514 microversion: 2.1 time: 2.511289 Apr 20 19:20:47.835684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 240/468] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:45 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1514 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:47.840631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:47.841289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:47.865641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:47.866172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:47.867015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:47.867500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:48.091730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:48.115071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:48.117091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:48.118548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5e467d22-76d2-4635-8052-a2d22c21b530 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 1.430112 Apr 20 19:20:48.119348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 229/469] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:46 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:48.124240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:48.126596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:48.143643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:48.147784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:48.148824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:48.149466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:48.741670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:48.763239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e0ac6444-4698-436c-be30-22dd733ff5fc tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1568 microversion: 2.1 time: 0.925790 Apr 20 19:20:48.766142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 241/470] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:47 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1568 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:48.865168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:48.866669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:48.886935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:48.893119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:48.895397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:48.896396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:49.845154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:49.864045 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c743a4e0-4a1f-4f8e-a5ff-2b1af780fa9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1714 microversion: 2.1 time: 1.743421 Apr 20 19:20:49.864953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 230/471] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:48 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1714 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:49.870011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:49.871186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:49.879539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:49.880300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:49.881314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:49.882013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:50.650578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:50.675580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d2592419-e932-4eee-8d1e-b037bf556ca8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1514 microversion: 2.1 time: 1.826447 Apr 20 19:20:50.676238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 242/472] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:48 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1514 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:50.690350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:50.691039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:50.732164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:50.732678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:50.733508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:50.742578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:50.997018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:51.009343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:51.021127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:51.022468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5504282b-b5bd-4f6a-9967-76876d46cb93 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 1.156332 Apr 20 19:20:51.027800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 231/473] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:49 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:51.684609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-8183252d-8ea8-4dc2-a5c5-bba88c6e9798 req-bdb826ba-ea78-46bf-ab44-f61870b9ffd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849c1a32-0a61-408c-9cae-f0931eb6b1e3", "name": "network-vif-deleted", "tag": "6455816e-56e4-494c-9c38-9280518b6817"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:51.686909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:20:51.686909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:20:51.711251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8183252d-8ea8-4dc2-a5c5-bba88c6e9798 req-bdb826ba-ea78-46bf-ab44-f61870b9ffd8 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:51.711755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8183252d-8ea8-4dc2-a5c5-bba88c6e9798 req-bdb826ba-ea78-46bf-ab44-f61870b9ffd8 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:51.813066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:51.834649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b2e718c5-ebd7-4dd7-af86-69fed88209aa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1548 microversion: 2.1 time: 1.157190 Apr 20 19:20:51.835281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 243/474] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:50 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1548 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:51.854090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:51.855547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-8183252d-8ea8-4dc2-a5c5-bba88c6e9798 req-bdb826ba-ea78-46bf-ab44-f61870b9ffd8 service nova] Creating event network-vif-deleted:6455816e-56e4-494c-9c38-9280518b6817 for instance 849c1a32-0a61-408c-9cae-f0931eb6b1e3 on hv-cinder-78693 Apr 20 19:20:51.856432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:51.890253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:51.891124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:51.892214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:51.892861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:51.902188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-8183252d-8ea8-4dc2-a5c5-bba88c6e9798 req-bdb826ba-ea78-46bf-ab44-f61870b9ffd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225456 Apr 20 19:20:51.902844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 232/475] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:20:51.922862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:51.935163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:51.964164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:51.983753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:51.985081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:51.994764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:52.192757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:52.193341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:52.193765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'fault' on Instance uuid 849c1a32-0a61-408c-9cae-f0931eb6b1e3 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:20:52.427746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] HTTP exception thrown: Cannot 'detach_volume' instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 while it is in vm_state rescued Apr 20 19:20:52.429050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Returning 409 to user: Cannot 'detach_volume' instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 while it is in vm_state rescued {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:20:52.430181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-48df7723-4ea7-4a85-959d-68084a0179e9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments/ed5bb8c0-5103-4544-8b75-7cd8ec35e371" status: 409 len: 152 microversion: 2.1 time: 0.525885 Apr 20 19:20:52.442623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 233/476] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:20:51 2021] DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments/ed5bb8c0-5103-4544-8b75-7cd8ec35e371 => generated 152 bytes in 539 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:20:52.448480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:52.449419 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:52.459668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:52.462458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:52.463582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:52.470871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:53.014892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:53.041956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2ac74da5-d565-4506-ba0e-7dbc52174ef0 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 200 len: 1308 microversion: 2.1 time: 1.194651 Apr 20 19:20:53.050198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 244/477] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:51 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 1308 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:53.056118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:20:53.062718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:53.083789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:53.084691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:53.085752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:53.086497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:53.402443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-27ad56d5-6231-4dbf-a71d-3269d5b34d4a tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action" status: 202 len: 0 microversion: 2.1 time: 0.350389 Apr 20 19:20:53.403900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 245/478] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:20:53 2021] POST /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:20:53.417634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:53.430922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:53.439917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:53.440749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:53.441820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:53.442534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:54.458871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:54.477355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:54.479074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:54.480337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9c4d836c-350b-4e12-b328-1ccb0b1e51ce tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 2.036253 Apr 20 19:20:54.480930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 234/479] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:52 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:54.493799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:54.514901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 849c1a32-0a61-408c-9cae-f0931eb6b1e3] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:54.523607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:54.524719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:54.537203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:54.537887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:54.657258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Instance 849c1a32-0a61-408c-9cae-f0931eb6b1e3 could not be found. Apr 20 19:20:54.667406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 404 to user: Instance 849c1a32-0a61-408c-9cae-f0931eb6b1e3 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:20:54.668705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0a39d9bd-6b39-41bb-8b36-779ca0c3d80d tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3" status: 404 len: 111 microversion: 2.1 time: 0.181862 Apr 20 19:20:54.669532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 235/480] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:54 2021] GET /compute/v2.1/servers/849c1a32-0a61-408c-9cae-f0931eb6b1e3 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:20:54.681059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:54.681778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:54.699087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:54.701505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:54.702692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:54.710635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:54.838480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:54.879698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8b513325-de73-4892-b248-eacebc595cba tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 1.466825 Apr 20 19:20:54.880938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 246/481] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:53 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:54.895205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:20:55.109598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a6ec229d-ba7c-4932-90a7-14c9d8d5d084 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 204 len: 0 microversion: 2.1 time: 0.435081 Apr 20 19:20:55.110611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 236/482] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:20:54 2021] DELETE /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:20:55.119581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:55.120261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:55.141316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.141943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:55.142865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.143360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:55.504898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:55.505672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:55.536707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.537560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:55.538098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.538596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:55.624798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:55.643631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c118fa6f-7c0c-4b17-bca2-54a47dd64537 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.528332 Apr 20 19:20:55.654761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 247/483] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:55 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:55.899435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:55.906228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:55.923402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.927559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:55.928810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:55.929637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:56.840247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:56.870941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:56.876835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:56.878921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:56.884660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ee20dc86-c79a-4af2-bb9a-dbd554f60b12 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.989694 Apr 20 19:20:56.885313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 248/484] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:55 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:56.886528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df73a2fa-c4af-4182-8faf-2f8b8dcab755 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 1.386375 Apr 20 19:20:56.887243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 237/485] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:55 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:20:56.903500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:56.904175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:56.934442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:56.935290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:56.938153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:56.938858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:57.428902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:57.439789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9620389b-49bb-4509-b6fc-cf367dbc82f2 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.540498 Apr 20 19:20:57.440715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 249/486] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:56 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:57.908436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:57.911125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:57.918613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:57.919332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:57.922822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:57.923555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:57.924611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:57.925302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:57.931653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:57.932169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:57.933023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:57.933510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:58.355705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:58.370197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1d95dc73-c5d9-4db4-8493-e3991a3ed53b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.466075 Apr 20 19:20:58.372658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 238/487] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:57 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:58.387290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:58.401435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:58.403504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:58.405292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0b9eec4a-b555-4ae3-92a9-3e29b910a490 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 0.490799 Apr 20 19:20:58.406839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 250/488] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:57 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:20:58.460525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:58.461799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:58.472026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:58.472862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:58.474134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:58.474839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:58.744969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:58.755833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4020f23b-72fc-4971-82c0-390dafb3ff84 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.300704 Apr 20 19:20:58.756963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 239/489] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:58 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:20:59.392943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:59.393644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:59.407464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.407974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.408825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.409319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.428949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:59.430206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:59.443000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.444073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.445238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.446062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.944905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:59.960983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b075f671-3690-4cf7-a15d-0762e8643652 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.574199 Apr 20 19:20:59.962062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 251/490] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:59 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:20:59.973850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:59.981245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:59.982053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:20:59.991419 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:59.992646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.993218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.993414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:20:59.994270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:59.994734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e17121d2-82af-424a-97b0-724f25be690a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1738 microversion: 2.20 time: 0.569933 Apr 20 19:20:59.994843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:59.995333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 240/491] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:20:59 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1738 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:00.223283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:00.233342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-88da3461-03a8-4986-ba9b-0b940ab93e56 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.269967 Apr 20 19:21:00.234067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 252/492] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:20:59 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:00.980653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:00.981437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:00.990658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:00.991208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:00.992263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:00.992903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:01.016573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:01.017641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:01.026644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:01.027266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:01.028181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:01.028743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:01.379167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:01.390356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:01.393183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:01.395378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:01.396171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-70f4de11-0853-4432-b267-d9f99305fc73 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.385863 Apr 20 19:21:01.398960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 253/493] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:01 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:01.402130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:01.402777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:01.410664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1128d96f-fed5-4a86-9d4e-a069536e012b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.433833 Apr 20 19:21:01.411226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:01.411744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:01.412074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 241/494] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:00 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:01.422278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:01.422278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:01.650205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:01.664179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ee9fc4d4-252b-423c-898e-64cc67fa800a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.266227 Apr 20 19:21:01.665155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 254/495] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:01 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:02.416430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:02.418421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:02.430229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.430845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.432147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.432861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.433427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:02.434521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:02.445635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.476203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.476203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.476203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.868537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:02.879454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:02.881633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:02.883088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a69048ad-1f14-4a13-a0e0-bcf1afe0dffa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.471085 Apr 20 19:21:02.887211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 242/496] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:02 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:02.892840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:02.893750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:02.902716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.903461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.904469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:02.905108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:02.906322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:02.916944 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a83a76e-5396-4bfc-8829-04bb09243d81 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.490046 Apr 20 19:21:02.917781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 255/497] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:02 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:03.201325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:03.211112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-090d4d2d-3b14-4e57-a903-e3c20bfb0679 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.322408 Apr 20 19:21:03.211728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 243/498] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:02 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:03.256623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'create', calling method: .version_select at 0x7fd8e028aa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-888872452"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:03.284081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for project d3c1c47f974a4031bc62166d5cf50696. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:03.288953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for user f3b113a4487e4921a36c55cce6a014c9 and project d3c1c47f974a4031bc62166d5cf50696. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:03.301703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [0cf65c53-d625-43e3-83b3-07a158e10560] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 19:21:03.910614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:03.911751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:03.924240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:03.925039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:03.926330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:03.927130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:04.156972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:04.166773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:04.168445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:04.169702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f489aecf-4a65-4767-af35-ba4b959fb89a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.265309 Apr 20 19:21:04.170355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 244/499] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:03 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:04.175236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:04.175862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:04.183825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:04.184322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:04.185166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:04.185696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:04.320683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [0cf65c53-d625-43e3-83b3-07a158e10560] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50190. Apr 20 19:21:04.406213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:04.416243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9ea81722-7aaf-4fa0-bd9c-88c1f2a200d1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.244724 Apr 20 19:21:04.417168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 245/500] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:04 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:04.421917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:04.422696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:04.430705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:04.431315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:04.432260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:04.432954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:04.501859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for project d3c1c47f974a4031bc62166d5cf50696. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:04.505926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for user f3b113a4487e4921a36c55cce6a014c9 and project d3c1c47f974a4031bc62166d5cf50696. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:04.519709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2f49602a-6304-471a-95f0-2a51b126d9e5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.267183 Apr 20 19:21:04.520367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 256/501] 10.222.0.48 () {60 vars in 1148 bytes} [Tue Apr 20 19:21:03 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:04.661659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:04.671389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f90f3cfd-75b0-454e-8ba0-d70a2cbc72aa tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.253221 Apr 20 19:21:04.672231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 246/502] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:04 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:04.698711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-260530298", "imageRef": "bcd68a82-11c5-4b41-b750-ef92fc6060fc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-888872452", "networks": [{"uuid": "49aebcba-8b56-48f1-a78e-35728f8d77f0"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:04.773345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] validate_networks() for [('49aebcba-8b56-48f1-a78e-35728f8d77f0', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:21:05.189377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:05.190199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:05.198418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.198953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.199874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.200367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.430915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:21:05.431365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:21:05.431916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:21:05.432384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:21:05.432850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:21:05.442565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.443080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.444124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.444627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.464026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for project d3c1c47f974a4031bc62166d5cf50696. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:05.468545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Getting quotas for user f3b113a4487e4921a36c55cce6a014c9 and project d3c1c47f974a4031bc62166d5cf50696. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:05.480661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:21:05.483348 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bcd68a82-11c5-4b41-b750-ef92fc6060fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:21:05.502738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:05.513021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:05.514733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:05.516024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ba92068-9662-49d1-9328-2b89c07dc793 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.331054 Apr 20 19:21:05.516660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 247/503] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:05 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:05.521448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:05.522500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:05.530511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.531014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.531895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.532357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.539880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d66b492e-8573-4152-b7e9-14199b3219b5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845378 Apr 20 19:21:05.540555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 257/504] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:21:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:21:05.551775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d4f2ed9c-8bea-4659-9465-4b80704cf791 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:05.552445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d4f2ed9c-8bea-4659-9465-4b80704cf791 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:05.684240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d4f2ed9c-8bea-4659-9465-4b80704cf791 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:05.692195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d4f2ed9c-8bea-4659-9465-4b80704cf791 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1257 microversion: 2.1 time: 0.144551 Apr 20 19:21:05.693000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 258/505] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:05 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1257 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:05.697481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:05.698294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:05.708065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.708658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.709557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:05.710310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:05.780741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:05.791402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e0190d9c-c5e4-4459-9501-b1cd0f3c789f tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.273501 Apr 20 19:21:05.792054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 248/506] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:05 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:06.009909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-2d88c342-f459-430e-9ca5-f29fcfd56ad2 req-689dd76a-d34b-4a7a-91a2-1eee652871f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "name": "network-vif-unplugged", "status": "completed", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:06.011922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:06.011922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:06.025184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2d88c342-f459-430e-9ca5-f29fcfd56ad2 req-689dd76a-d34b-4a7a-91a2-1eee652871f5 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.025771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2d88c342-f459-430e-9ca5-f29fcfd56ad2 req-689dd76a-d34b-4a7a-91a2-1eee652871f5 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.090844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-2d88c342-f459-430e-9ca5-f29fcfd56ad2 req-689dd76a-d34b-4a7a-91a2-1eee652871f5 service nova] Creating event network-vif-unplugged:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:21:06.111907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-2d88c342-f459-430e-9ca5-f29fcfd56ad2 req-689dd76a-d34b-4a7a-91a2-1eee652871f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105910 Apr 20 19:21:06.112883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 249/507] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:06.514770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:06.525171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4c779b30-958a-4216-823c-9beaeeb5c429 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1513 microversion: 2.1 time: 0.831285 Apr 20 19:21:06.525781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 259/508] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:05 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1513 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:06.536793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:06.537567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:06.545888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.546403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.547250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.547747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.710954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:06.711666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:06.725253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.725766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.726668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.727172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.769804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:06.780183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:06.781989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:06.783329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-79f79b04-c2e5-47fc-a420-c2425d06a145 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.251115 Apr 20 19:21:06.784026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 250/509] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:06 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:06.789049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-bcf5cc97-6726-49a2-a27d-bedf27e726fe req-aa378619-f80b-476e-ad34-12b803e70a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358d3991-d8f0-4906-b8b5-33be33d27480", "name": "network-vif-deleted", "tag": "cdfa5087-dd7b-4e2e-bec8-adc661ef0728"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:06.790933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:06.790933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:06.800046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bcf5cc97-6726-49a2-a27d-bedf27e726fe req-aa378619-f80b-476e-ad34-12b803e70a52 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.800634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-bcf5cc97-6726-49a2-a27d-bedf27e726fe req-aa378619-f80b-476e-ad34-12b803e70a52 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.821879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-bcf5cc97-6726-49a2-a27d-bedf27e726fe req-aa378619-f80b-476e-ad34-12b803e70a52 service nova] Creating event network-vif-deleted:cdfa5087-dd7b-4e2e-bec8-adc661ef0728 for instance 358d3991-d8f0-4906-b8b5-33be33d27480 on hv-cinder-78693 Apr 20 19:21:06.827638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-bcf5cc97-6726-49a2-a27d-bedf27e726fe req-aa378619-f80b-476e-ad34-12b803e70a52 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042264 Apr 20 19:21:06.828320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 251/510] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:06.833700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:06.834500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:06.842892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.843404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.844253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:06.844747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:06.851028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:06.860187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c8725f4a-fde5-4fa9-b63a-512af4b491e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1309 microversion: 2.1 time: 0.153428 Apr 20 19:21:06.860808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 260/511] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:06 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:07.068198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:07.081188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6d0973ee-b971-427b-ac29-a08fdf099d86 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.251530 Apr 20 19:21:07.081959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 252/512] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:06 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:07.543778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:07.545221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:07.553875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.554571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:07.555598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.556091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:07.689852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:07.699015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a701a85a-a241-4469-b13a-69500e3d8b72 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1471 microversion: 2.1 time: 0.159742 Apr 20 19:21:07.699637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 261/513] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:07 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:07.802967 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:07.803558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:07.811977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.812492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:07.813333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.813847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:07.878957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:07.879649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:07.887778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.888256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:07.889144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:07.889636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:08.018673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.027925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3ed6957e-6172-4390-a283-b3a85b9459e9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1309 microversion: 2.1 time: 0.153189 Apr 20 19:21:08.028520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 262/514] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:07 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:08.085109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.096800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.099093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.100393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-19f75787-0085-4a03-b984-40b3a7f42d11 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.301822 Apr 20 19:21:08.100629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:08.101161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 253/515] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:07 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:08.101303 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:08.110256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:08.110766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:08.111610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:08.112098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:08.332788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.343957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-90f90d48-2ec5-4259-8033-7e509a9652a0 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.247905 Apr 20 19:21:08.346302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 263/516] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:08 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:08.717784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:08.718484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:08.727100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:08.727606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:08.728457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:08.728961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:08.854575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:08.863796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9a2df641-ec1e-4780-bbf4-3542c0da840a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1471 microversion: 2.1 time: 0.150218 Apr 20 19:21:08.864426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 254/517] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:08 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:09.051088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:09.051745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:09.063715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.064158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.064992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.065461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.120789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:09.121485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:09.129657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.130195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.131033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.131518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.193684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:09.203519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fa0254d7-5fc7-4f9c-ba9b-79623b107959 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1309 microversion: 2.1 time: 0.159394 Apr 20 19:21:09.204162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 264/518] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:09 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:09.364526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:09.365112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:09.373251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.373991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.374830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.375320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.556242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:09.566315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:09.568000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:09.569237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e6b1e68d-274e-4740-9fd9-71645cb2cb30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.452799 Apr 20 19:21:09.570080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 255/519] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:09 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:09.772964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:09.786330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bebc91cb-249f-473a-ac47-e5bf20862668 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.426500 Apr 20 19:21:09.799122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 265/520] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:09 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:09.882214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:09.882839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:09.891630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.892111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.892973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.893463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.976468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:09.976924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:09.977383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'fault' on Instance uuid 358d3991-d8f0-4906-b8b5-33be33d27480 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:10.044952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:10.054346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-04bfa8af-5a69-4a2c-b56c-cbf8e7ef43e3 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1307 microversion: 2.1 time: 0.176289 Apr 20 19:21:10.066211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 256/521] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:09 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:10.222514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:10.223476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:10.231746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.232257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.233393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.233911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.360477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:10.369658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-12a9dc3b-63a5-42f3-8e31-1a330b49c28b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1327 microversion: 2.1 time: 0.151420 Apr 20 19:21:10.381105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 266/522] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:10 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:10.588999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:10.589664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:10.597935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.598443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.599275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.599766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.805031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:10.805706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:10.813948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.814540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.815464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:10.816022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:10.820971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:10.834063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:10.835725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:10.837247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-13174433-5bcf-4015-b4f7-4e4951d9ca5d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.252558 Apr 20 19:21:10.838307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 257/523] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:10 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:11.050256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:11.060778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-42a73ad9-6834-456c-8eab-a39278b53b56 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.260030 Apr 20 19:21:11.061635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 267/524] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:10 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:11.073062 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:11.073825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:11.082574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.083067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.083943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.084493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.158092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.158617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.159122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'fault' on Instance uuid 358d3991-d8f0-4906-b8b5-33be33d27480 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:11.226390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:11.235324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6bf67824-ccf7-4e8c-bcee-07380cfc29ed tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1307 microversion: 2.1 time: 0.166527 Apr 20 19:21:11.235951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 258/525] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:11 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:11.393824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:11.394850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:11.407296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.407800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.408632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.409123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.543265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:11.552905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6d3348b0-b9dc-4385-aacf-2a65e58fbfea tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1327 microversion: 2.1 time: 0.165965 Apr 20 19:21:11.553541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 268/526] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:11 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:11.859739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:11.860694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:11.871218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.871851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:11.872892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:11.873504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.079876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:12.080552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:12.088707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.089215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.090092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.090590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.095971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.105823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.107562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.108764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-18f50908-634a-4329-b15b-f7e692d9f452 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.255092 Apr 20 19:21:12.109394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 259/527] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:11 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:12.252890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:12.253603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:12.261893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.262444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.263289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.263788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.327582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.337547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fd4a3902-e7f5-42e7-a2cb-65628049045b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.261693 Apr 20 19:21:12.337726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.338086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.338332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 269/528] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:12 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:12.338940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'fault' on Instance uuid 358d3991-d8f0-4906-b8b5-33be33d27480 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:12.405547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.419167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-60561916-c7ae-4bc3-a58b-09a8178681c6 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 200 len: 1307 microversion: 2.1 time: 0.170175 Apr 20 19:21:12.419978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 260/529] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:12 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:12.575611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:12.576603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:12.586220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.586747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.587583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:12.588076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:12.711451 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:12.720935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-53db85c9-0d44-4fd8-b3c5-093b248da279 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1327 microversion: 2.1 time: 0.152340 Apr 20 19:21:12.721565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 270/530] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:12 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:13.128794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:13.130452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:13.139567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.140221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.141299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.141928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.371720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:13.372594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:13.390266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.393312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.396350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.396683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:13.398196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.407160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:13.408934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:13.410120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8ab08567-ef85-4abb-af43-c64793d7213b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.285972 Apr 20 19:21:13.410754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 261/531] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:13 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:13.440840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:13.441518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 358d3991-d8f0-4906-b8b5-33be33d27480] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:13.465876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.466987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.467904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.468416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.567363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Instance 358d3991-d8f0-4906-b8b5-33be33d27480 could not be found. Apr 20 19:21:13.568175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 404 to user: Instance 358d3991-d8f0-4906-b8b5-33be33d27480 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:13.569015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9c30a2b1-931f-4f3f-96b7-384639c75e39 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480" status: 404 len: 111 microversion: 2.1 time: 0.133280 Apr 20 19:21:13.569682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 262/532] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:13 2021] GET /compute/v2.1/servers/358d3991-d8f0-4906-b8b5-33be33d27480 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:13.742612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:13.743515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:13.754372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.757548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.758869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:13.759743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:13.803479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:13.833925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ec12f959-e9ce-48ca-a1cc-9361ad1e7c51 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1556 microversion: 2.1 time: 0.477950 Apr 20 19:21:13.834569 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 271/533] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:13 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1556 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:14.195997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:14.210285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6c97c709-ce67-47ae-80f6-82e8cb017565 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.474384 Apr 20 19:21:14.211478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 263/534] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:13 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:14.431318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:14.432130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:14.440517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.441634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:14.442618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.443482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:14.686572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:14.697205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:14.698902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:14.700485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ea6c60a1-2863-45db-ba93-4d3757a84a15 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.275183 Apr 20 19:21:14.701081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 272/535] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:14 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:14.853714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:14.854418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:14.863107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.863619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:14.864557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.864946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:14.938872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:14.939605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:14.948240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.948973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:14.950029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:14.950671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.030363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:21:15.167789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:15.179243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-68bf0ca8-b0b5-4f2e-a9bc-4df9a618bfa6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1562 microversion: 2.1 time: 0.330129 Apr 20 19:21:15.180780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 264/536] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:14 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1562 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:15.213487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-375a6eec-2464-4ec2-9b6f-2c362887c559 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 204 len: 0 microversion: 2.1 time: 0.276667 Apr 20 19:21:15.217609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 273/537] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:21:14 2021] DELETE /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:21:15.223732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:15.224959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:15.231013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:15.231793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:15.240699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.241227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.242115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.242603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.256862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.257369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.258269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.258760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.577093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:15.586821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2445ae3b-ebcc-4248-8a97-65f76bb53e62 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.367289 Apr 20 19:21:15.587628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 265/538] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:15 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:15.593922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:15.594484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:15.603017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.603830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.604795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.605503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.643471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:15.663029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e2701de6-8666-4549-acc1-77df266d1efb tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.436374 Apr 20 19:21:15.663743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 274/539] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:15 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:15.720628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:15.721539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:15.729763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.730386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.731339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:15.731813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:15.804092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'services' on Instance uuid eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:16.010772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ddfbbea-8a0f-4215-be17-2386bc2d58e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments/ed5bb8c0-5103-4544-8b75-7cd8ec35e371" status: 202 len: 0 microversion: 2.1 time: 0.421327 Apr 20 19:21:16.011639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 266/540] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:21:15 2021] DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1/os-volume_attachments/ed5bb8c0-5103-4544-8b75-7cd8ec35e371 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:21:16.015209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:16.026874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:16.028544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:16.029843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0f841e2b-20a0-4c28-94ea-1b91bdbacd7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.313518 Apr 20 19:21:16.033917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 275/541] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:15 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:16.607795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:16.609161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:16.619602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:16.620342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:16.621416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:16.622086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:16.682770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:16.683571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:16.692770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:16.693351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:16.694441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:16.695116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:16.935370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:16.945302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4aa40622-e08a-4e09-a801-9fc655eaee81 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.343073 Apr 20 19:21:16.946076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 267/542] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:16 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:16.996661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:17.007197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a09a0fb5-8391-49eb-a9b7-b88dcade2d8d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.328514 Apr 20 19:21:17.007843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 276/543] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:16 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:17.058894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:17.059875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:17.079934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.080716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:17.081733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.082395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:17.271532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:17.272312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:17.280915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.281423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:17.282507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.283040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:17.325255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:17.338943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:17.340582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:17.341821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2452abe8-cb19-4770-91e9-312cbdd6f254 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.296168 Apr 20 19:21:17.342667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 268/544] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:17 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:17.470710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lazy-loading 'services' on Instance uuid aa214411-492e-4ee0-9679-c3255f6b0f5e {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:17.621633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84e8c390-ef39-479e-b767-025983bc677b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e/os-volume_attachments/986387be-ef68-452d-a851-2a8ac63822ff" status: 202 len: 0 microversion: 2.1 time: 0.361006 Apr 20 19:21:17.622515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 277/545] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:21:17 2021] DELETE /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e/os-volume_attachments/986387be-ef68-452d-a851-2a8ac63822ff => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:21:17.964788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:17.965547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:17.974225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.974829 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:17.975774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:17.976268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:18.026761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:18.027688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:18.036129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:18.036621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:18.037779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:18.038891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:18.411131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:18.422442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dcbf4d9f-1aa2-4694-b6af-39c529fc39f8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.461737 Apr 20 19:21:18.423108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 269/546] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:17 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:18.428147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:18.428811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:18.437119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:18.437624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:18.438506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:18.439001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:18.440179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:18.456960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a2928a69-edd1-433d-a963-47f1ed3edd18 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.433434 Apr 20 19:21:18.459356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 278/547] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:18 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:18.747148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:18.757171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:18.759129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:18.760365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f65c14bd-127f-446e-9e4c-c62be3c7dc44 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.336040 Apr 20 19:21:18.760977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 270/548] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:18 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:19.442246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:19.443291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:19.452899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:19.453600 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:19.466439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:19.467215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:19.478534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:19.479208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:19.494999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:19.495641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:19.496729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:19.497663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:20.178179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:20.188223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3bc2885b-49bb-4397-a8ef-acb26aa39c07 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.750007 Apr 20 19:21:20.188874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 279/549] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:19 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:20.193817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:20.194513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:20.202441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:20.202991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:20.204261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:20.204755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:20.218527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:20.231652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0cc07cf6-1bbb-42b5-96f1-500a07798bdf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.758213 Apr 20 19:21:20.232326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 271/550] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:19 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:20.538007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:20.549130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:20.550842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:20.552299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-46c6e1ae-6ee8-47ec-9b68-aa4e0234b84c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.362451 Apr 20 19:21:20.553879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 280/551] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:20 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:21.208731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:21.209417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:21.219145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.219855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.221068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.221752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.250943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:21.251981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:21.279147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.279675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.280591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.287130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.699224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:21.707353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:21.717811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-68ef8f81-731e-41ae-aad2-b898acbe45b8 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.515362 Apr 20 19:21:21.718467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 272/552] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:21 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:21.721781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-940a24ca-2b17-4ef7-a610-cad4730c6a0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.476395 Apr 20 19:21:21.723897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:21.724627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:21.734402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.735153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.736112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:21.736745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:21.739848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 281/553] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:21 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:21.995685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:22.006749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:22.008647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:22.009916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5c0f5e6f-2e01-4263-8cc1-bd41dd8bea1e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.289890 Apr 20 19:21:22.010545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 273/554] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:21 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:22.736529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:22.744313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:22.745470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:22.746583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:22.762432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:22.764392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:22.765179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:22.766360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:22.766916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:22.767930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:22.768507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:22.769432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:23.184433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:23.199233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fda1b979-7463-46db-b80e-32d8946087c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.458758 Apr 20 19:21:23.200519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 274/555] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:22 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:23.207424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:23.212902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:23.228521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:23.234651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:23.235819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:23.236497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:23.756587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:23.775962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4f797837-758d-4213-af52-80ddc653f4f4 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 1.043785 Apr 20 19:21:23.791065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 282/556] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:22 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:23.813519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:23.834414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:23.837983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:23.840035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-59dd7b49-d2b0-45ed-b379-7b7fedd367fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.638324 Apr 20 19:21:23.846224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 275/557] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:23 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:24.219307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:24.220097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:24.237755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.238294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:24.239158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.239651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:24.521526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:24.533561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-691bdd51-9012-4803-a653-dde0739bdd3a tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.319160 Apr 20 19:21:24.542671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 283/558] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:24 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:24.811152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:24.811152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:24.818716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.819593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:24.820570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.821929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:24.860224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:24.861159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:24.870164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.870957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:24.872036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:24.872709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:25.261180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:25.272749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1f954c90-7578-44c6-bbc4-3b9b3069b11e tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.478071 Apr 20 19:21:25.273401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 276/559] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:24 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:25.299145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:25.311436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:25.313363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:25.314796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c2932445-d1a1-4af5-b88a-746012c362e4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.458794 Apr 20 19:21:25.315910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 284/560] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:24 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:25.567985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:25.568959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:25.581307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:25.581807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:25.582685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:25.583171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:25.966231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:25.979218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-230188a0-0e33-465d-8ab2-fa5fc64de49b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.423275 Apr 20 19:21:25.980919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 277/561] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:25 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:26.290923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:26.291921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:26.300582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:26.301197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:26.302119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:26.302720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:26.335191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:26.336148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:26.347444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:26.348166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:26.349184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:26.349853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:26.599992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:26.611299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b288ca39-7672-4d71-bcf8-13d5e10bac18 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.324592 Apr 20 19:21:26.612085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 285/562] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:26 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:26.684324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:26.695780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:26.697523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:26.699629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9b4c9f2b-429d-4bf1-a7b4-fe5b22d0ce7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.368300 Apr 20 19:21:26.701516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 278/563] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:26 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:26.998805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:27.000089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:27.009661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.010362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.011588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.012353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.284852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:27.294889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8395193b-3c46-4ffb-85d5-a051830c5bfc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.300741 Apr 20 19:21:27.295488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 286/564] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:26 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:27.429941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-0356235f-4797-4e35-898f-a2804f2f2cd2 req-d0c19a4d-9016-419e-b094-4524225b58e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:27.432370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:27.432370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:27.444102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0356235f-4797-4e35-898f-a2804f2f2cd2 req-d0c19a4d-9016-419e-b094-4524225b58e6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.444986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0356235f-4797-4e35-898f-a2804f2f2cd2 req-d0c19a4d-9016-419e-b094-4524225b58e6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.468408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-0356235f-4797-4e35-898f-a2804f2f2cd2 req-d0c19a4d-9016-419e-b094-4524225b58e6 service nova] Creating event network-changed:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:21:27.474945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-0356235f-4797-4e35-898f-a2804f2f2cd2 req-d0c19a4d-9016-419e-b094-4524225b58e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049741 Apr 20 19:21:27.475886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 279/565] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:27.630252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:27.631791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:27.642593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.643453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.644851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.645347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.723355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:27.724011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:27.732699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.733199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.734080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:27.734570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:27.990325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:28.003383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-36a078c8-606a-488e-850e-dbccaf61d892 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.378086 Apr 20 19:21:28.012286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 287/566] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:27 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:28.133762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:28.144677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:28.146799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:28.148171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ea93e6bd-74b0-4ba5-b8c8-cf70523a7eca tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.432300 Apr 20 19:21:28.148854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 280/567] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:27 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:28.312975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:28.313670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:28.322231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:28.322737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:28.323563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:28.324223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:28.559233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:28.569758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f7f60651-ce25-4961-b3ed-2c8ea668461b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.260771 Apr 20 19:21:28.570529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 288/568] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:28 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:29.025203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:29.025932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:29.034280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.034797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.035598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.036288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.168034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:29.168706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:29.181908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.188642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.189580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.190259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.617047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:29.640838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:29.641124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:29.643556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:29.645019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-36313c2a-bfb8-458c-9c1d-6409d84b0aa9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1720 microversion: 2.20 time: 0.481410 Apr 20 19:21:29.646149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 289/569] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:29 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1720 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:29.651585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:29.652487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:29.653517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dddda546-6be3-48dd-8830-b86ec438cc66 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.632350 Apr 20 19:21:29.655933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 281/570] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:29 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:29.661750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.662662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.663721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:29.664584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:29.957486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:29.967894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-929f028f-af64-40a0-b223-0e562e6251f6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.320406 Apr 20 19:21:29.969311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 290/571] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:29 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:30.511902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:30.512474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:30.523755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.524246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:30.525280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.525755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:30.591753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:21:30.664870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:30.665508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:30.679676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.680194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:30.681069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.681571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:30.812726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-727a74a4-31ee-4b7b-a0ad-7a6d655b268c tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 204 len: 0 microversion: 2.1 time: 0.304569 Apr 20 19:21:30.813342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 282/572] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:21:30 2021] DELETE /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:21:30.833408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:30.836871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:30.856956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.857481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:30.858388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:30.858866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.346249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.358861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.363367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.369926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b400b1d7-664d-47af-9744-0ddf19716e8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1663 microversion: 2.20 time: 0.709252 Apr 20 19:21:31.370593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 291/573] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:30 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1663 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:31.387013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.399166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:31.401453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:31.406178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f871af69-e894-4a0e-88d1-5c410009dfb9 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1514 microversion: 2.1 time: 0.586744 Apr 20 19:21:31.408391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 283/574] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:30 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1514 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:31.421498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:31.422402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:31.423989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.425030 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.429113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.429702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.433174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.434016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.435783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.436762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.821320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.838100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:31.845005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-86ca2029-5132-46d5-94d1-8016bd49fcc8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.432288 Apr 20 19:21:31.846753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 284/575] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:31 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:31.855167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d7e17bbd-64e4-482e-aa8b-a5ed70c09e1b tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1513 microversion: 2.1 time: 0.483285 Apr 20 19:21:31.856795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 292/576] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:31 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:31.861640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc8cfebb-1742-4123-a364-85809769f25a"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:31.863440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:31.864117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-97923de2-9e7c-467f-be2f-309b19dc0182 req-07401e98-394a-4c02-9b5f-55dade05a939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3e0d30-5d56-4781-baab-a9ef97961235", "name": "network-vif-deleted", "tag": "61058f3c-8b60-49a4-861f-fd84a5142bbc"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:31.866031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:31.866031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:31.873551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.874242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.875259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.876018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.883328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-97923de2-9e7c-467f-be2f-309b19dc0182 req-07401e98-394a-4c02-9b5f-55dade05a939 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:31.883989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-97923de2-9e7c-467f-be2f-309b19dc0182 req-07401e98-394a-4c02-9b5f-55dade05a939 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:31.905875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-97923de2-9e7c-467f-be2f-309b19dc0182 req-07401e98-394a-4c02-9b5f-55dade05a939 service nova] Creating event network-vif-deleted:61058f3c-8b60-49a4-861f-fd84a5142bbc for instance 3a3e0d30-5d56-4781-baab-a9ef97961235 on hv-cinder-78693 Apr 20 19:21:31.913863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-97923de2-9e7c-467f-be2f-309b19dc0182 req-07401e98-394a-4c02-9b5f-55dade05a939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053157 Apr 20 19:21:31.914601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 293/577] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:32.427009 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:32.427785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:32.432230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ec017534-c2ec-4ae5-8f14-cde5a0361ee2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.583888 Apr 20 19:21:32.442018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 285/578] 10.222.0.48 () {62 vars in 1354 bytes} [Tue Apr 20 19:21:31 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments => generated 188 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:32.443888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.444431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.445266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.445868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.604974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:32.605603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:32.614813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.615299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.622898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.627766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lazy-loading 'fault' on Instance uuid 3a3e0d30-5d56-4781-baab-a9ef97961235 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:32.630205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.631166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.631680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.735801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825e0fb1ce1741fd9735f09cd3da24b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5936ef70be44ac89df14ad4f1d0832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:32.750407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f3021734-77f6-4526-bdb4-c625a09e2f5a tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 200 len: 1308 microversion: 2.1 time: 0.327901 Apr 20 19:21:32.751396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 294/579] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:32 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:32.762846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:32.763716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:32.772242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.773053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.774169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.774852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.846083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:21:32.879434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c9c0c903-f35b-4120-bdae-9f392149aa8f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action" status: 202 len: 0 microversion: 2.20 time: 0.278843 Apr 20 19:21:32.883611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 286/580] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:21:32 2021] POST /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:21:32.888918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:32.889593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:32.899637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.900170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:32.901019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:32.901804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.036939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-69c6c0b1-d9a1-4496-b462-2bc18ab927fd tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 204 len: 0 microversion: 2.1 time: 0.283396 Apr 20 19:21:33.038802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 295/581] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:21:32 2021] DELETE /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:21:33.053323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:33.054483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:33.063672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.064471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.065707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.066519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.292628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.312003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-17707d88-d967-452f-9501-22718e3589c9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.427165 Apr 20 19:21:33.314566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 287/582] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:32 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:33.318177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:33.318842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:33.328250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.328767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.329628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.330192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.519571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.535968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3a46a40c-9882-4900-9b3f-0964a7cd96e3 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1513 microversion: 2.1 time: 0.495203 Apr 20 19:21:33.549463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 296/583] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:33 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1513 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:33.554696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:33.555364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:33.565203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.565710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.566587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.567768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.668143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.683423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.695068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.706545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b1283561-8859-4434-a24b-26ba7b21d670 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1749 microversion: 2.20 time: 0.392638 Apr 20 19:21:33.707220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 288/584] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:33 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1749 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:33.769782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:33.770502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] [instance: 3a3e0d30-5d56-4781-baab-a9ef97961235] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:33.786252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.786849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.787772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:33.788268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:33.904806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] HTTP exception thrown: Instance 3a3e0d30-5d56-4781-baab-a9ef97961235 could not be found. Apr 20 19:21:33.905483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] Returning 404 to user: Instance 3a3e0d30-5d56-4781-baab-a9ef97961235 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:33.906700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c480501b-9221-4fbf-9af9-3ac457ab92f7 tempest-AttachVolumeNegativeTest-530793537 tempest-AttachVolumeNegativeTest-530793537-project] 10.222.0.48 "GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235" status: 404 len: 111 microversion: 2.1 time: 0.141737 Apr 20 19:21:33.907374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 289/585] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:33 2021] GET /compute/v2.1/servers/3a3e0d30-5d56-4781-baab-a9ef97961235 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:33.970042 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:33.984494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3aeb9149-c177-4e79-b8b9-8f36b4862e97 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1508 microversion: 2.1 time: 0.433837 Apr 20 19:21:33.985289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 297/586] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:33 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:34.330199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:34.331338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:34.340124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.340924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.342007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.342694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.554368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:34.555060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:34.563559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.564063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.564929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.565565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.738144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:34.748548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a36ad033-0d3e-485b-96d5-55f8759de051 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.422346 Apr 20 19:21:34.749645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 290/587] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:34 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:34.754865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:34.755793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:34.764287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.765060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.766164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:34.767207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:34.944604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:34.958828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6323360c-cb59-4966-993f-11af843f6ae2 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1513 microversion: 2.1 time: 0.408713 Apr 20 19:21:34.959481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 298/588] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:34 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1513 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:35.003332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:35.003979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:35.019185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:35.020695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:35.022994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:35.025107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:35.157271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:35.177472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:35.180684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:35.183805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d8cd85c8-08ee-483c-b804-48513336c9cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1751 microversion: 2.20 time: 0.432819 Apr 20 19:21:35.198124 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 291/589] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:34 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1751 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:35.629234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-9a3fef4b-d307-4be3-96d6-3120cbd7045f req-e7e40328-36b4-42dd-bdab-e4b230759c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa214411-492e-4ee0-9679-c3255f6b0f5e", "name": "network-vif-deleted", "tag": "6231c497-6c68-4d14-8846-a83561edaf4c"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:35.632646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:35.632646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:35.669802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-9a3fef4b-d307-4be3-96d6-3120cbd7045f req-e7e40328-36b4-42dd-bdab-e4b230759c01 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:35.670489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-9a3fef4b-d307-4be3-96d6-3120cbd7045f req-e7e40328-36b4-42dd-bdab-e4b230759c01 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:35.696768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-9a3fef4b-d307-4be3-96d6-3120cbd7045f req-e7e40328-36b4-42dd-bdab-e4b230759c01 service nova] Creating event network-vif-deleted:6231c497-6c68-4d14-8846-a83561edaf4c for instance aa214411-492e-4ee0-9679-c3255f6b0f5e on hv-cinder-78693 Apr 20 19:21:35.705011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-9a3fef4b-d307-4be3-96d6-3120cbd7045f req-e7e40328-36b4-42dd-bdab-e4b230759c01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085133 Apr 20 19:21:35.707722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 292/590] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:35.754314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:35.775415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-160b6fd4-3e1c-4a8f-981d-575c73f5c322 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1508 microversion: 2.1 time: 0.776083 Apr 20 19:21:35.776482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 299/591] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:34 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1508 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:35.787218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:35.787218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:35.802952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:35.803554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:35.804633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:35.805282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:35.978400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:35.979980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:36.009068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:36.010223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:36.011369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:36.012142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:36.525700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:36.541756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5ada098-2682-48d3-ae04-b6a4c18ae250 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 200 len: 1303 microversion: 2.1 time: 0.568238 Apr 20 19:21:36.543806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 300/592] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:35 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 1303 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:36.549531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:36.550591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:36.561515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:36.562871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:36.563926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:36.565277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:36.981378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:36.994886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6b8619f0-f826-4d84-8a05-f49895473f07 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 1.224076 Apr 20 19:21:36.995552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 293/593] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:35 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:37.009483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:37.010215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:37.027804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:37.028315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:37.029208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:37.029711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:37.580945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:37.595373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:37.597524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:37.600454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1eaeb030-55c8-4c8d-8474-5138a8bd2184 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1751 microversion: 2.20 time: 1.055222 Apr 20 19:21:37.609205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 301/594] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:36 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1751 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:37.616342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:37.617314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: aa214411-492e-4ee0-9679-c3255f6b0f5e] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:37.627879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:37.629143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:37.630276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:37.631227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:37.714218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] HTTP exception thrown: Instance aa214411-492e-4ee0-9679-c3255f6b0f5e could not be found. Apr 20 19:21:37.715023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Returning 404 to user: Instance aa214411-492e-4ee0-9679-c3255f6b0f5e could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:37.716476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5d67878d-1cab-4aae-96cf-11b1a55b9215 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e" status: 404 len: 111 microversion: 2.1 time: 0.105619 Apr 20 19:21:37.717387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 302/595] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:37 2021] GET /compute/v2.1/servers/aa214411-492e-4ee0-9679-c3255f6b0f5e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:37.864624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:37.883601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84979cbb-8eea-4cf8-8876-b568ede1acad tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1508 microversion: 2.1 time: 0.884536 Apr 20 19:21:37.884481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 294/596] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:36 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1508 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:38.013576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:38.014273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:38.027349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.027792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.028928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.030946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.035762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-9b581710-2d3f-43db-85f1-b93e294ce21c req-e5e35f2a-a5af-4a06-b66d-c64ccc1af174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed22536-36ea-4a58-9a50-f724b719ad55", "name": "network-vif-deleted", "tag": "f1a70b57-4809-468b-bc54-39462d51aaa1"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:38.040443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:38.040443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:38.052547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-9b581710-2d3f-43db-85f1-b93e294ce21c req-e5e35f2a-a5af-4a06-b66d-c64ccc1af174 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.053383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-9b581710-2d3f-43db-85f1-b93e294ce21c req-e5e35f2a-a5af-4a06-b66d-c64ccc1af174 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.071806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-9b581710-2d3f-43db-85f1-b93e294ce21c req-e5e35f2a-a5af-4a06-b66d-c64ccc1af174 service nova] Creating event network-vif-deleted:f1a70b57-4809-468b-bc54-39462d51aaa1 for instance eed22536-36ea-4a58-9a50-f724b719ad55 on hv-cinder-78693 Apr 20 19:21:38.077449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-9b581710-2d3f-43db-85f1-b93e294ce21c req-e5e35f2a-a5af-4a06-b66d-c64ccc1af174 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048501 Apr 20 19:21:38.098971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 295/597] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:38.373524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:38.383328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-303f0c4e-1880-48f1-ae19-a34719e72341 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.374276 Apr 20 19:21:38.383954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 303/598] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:38 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:38.629305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:38.630702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:38.634390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-4e5a689f-9856-46b3-a435-86e16cf5052a req-3bdaa481-9426-42fa-98f7-e2a200af4243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "name": "network-vif-plugged", "status": "completed", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:38.637689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:38.637689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:38.640547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.641627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.642703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.643384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.649179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4e5a689f-9856-46b3-a435-86e16cf5052a req-3bdaa481-9426-42fa-98f7-e2a200af4243 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.649684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4e5a689f-9856-46b3-a435-86e16cf5052a req-3bdaa481-9426-42fa-98f7-e2a200af4243 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.680474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-4e5a689f-9856-46b3-a435-86e16cf5052a req-3bdaa481-9426-42fa-98f7-e2a200af4243 service nova] Creating event network-vif-plugged:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:21:38.687430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-4e5a689f-9856-46b3-a435-86e16cf5052a req-3bdaa481-9426-42fa-98f7-e2a200af4243 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056998 Apr 20 19:21:38.689221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 304/599] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:21:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:38.905309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:38.906251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:38.910421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:38.916676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.917182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.918115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.918690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.928772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:38.930939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:38.932585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-81fe6883-2d21-45bd-8d0f-5566f65961b9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1751 microversion: 2.20 time: 0.308226 Apr 20 19:21:38.933417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 296/600] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:38 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1751 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:38.995027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:38.995453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:38.996082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'fault' on Instance uuid eed22536-36ea-4a58-9a50-f724b719ad55 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:39.079312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:39.088680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d4bb3d7-b6de-4d66-98d8-03627c05f24b tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1312 microversion: 2.1 time: 0.189446 Apr 20 19:21:39.089787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 305/601] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:38 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:39.402327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:39.403067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:39.413591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:39.414250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:39.415325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:39.415917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:39.745132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:39.755701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3cd97e58-9252-4cb3-86ad-f5b9b0c085bf tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.357446 Apr 20 19:21:39.756609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 297/602] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:39 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:39.952523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:39.954133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:39.962199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:39.962710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:39.964359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:39.964977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:40.107640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:40.108871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:40.119302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:40.126178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:40.128621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:40.129703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:40.216254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:40.216937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:40.217578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'fault' on Instance uuid eed22536-36ea-4a58-9a50-f724b719ad55 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:40.294536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:40.304401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-39135c8d-effc-442d-ae1f-53fefa68098d tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1312 microversion: 2.1 time: 0.201113 Apr 20 19:21:40.306657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 298/603] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:40 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:40.327374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:40.338894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:40.341377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:40.343146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8d2bfbd5-37cf-4102-8c3b-27dc0c59a611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1751 microversion: 2.20 time: 0.394478 Apr 20 19:21:40.356665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 306/604] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:39 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1751 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:40.774757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:40.775423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:40.783290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:40.783983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:40.784978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:40.785611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.065385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:41.071617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2785e180-bf68-4af6-b86a-f737519d4a2b tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Action: 'create', calling method: .version_select at 0x7fd8e4ced048>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-932845440"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:41.089223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3e5f4cbb-2f07-49e0-8c01-24ee2f368181 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.317313 Apr 20 19:21:41.090890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 299/605] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:40 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:41.324344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:41.325017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:41.349591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.350129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.350990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.354335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.547029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.547273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.554162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'fault' on Instance uuid eed22536-36ea-4a58-9a50-f724b719ad55 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:41.645705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:41.657056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a0020ab-bc69-4044-a855-fd1b76b0b242 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 200 len: 1312 microversion: 2.1 time: 0.336608 Apr 20 19:21:41.658199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 300/606] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:41 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:41.664732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:41.665358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:41.689966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.690486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.691341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.691836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.858183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2785e180-bf68-4af6-b86a-f737519d4a2b tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.967824 Apr 20 19:21:41.860365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 307/607] 10.222.0.48 () {60 vars in 1145 bytes} [Tue Apr 20 19:21:40 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 970 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 19:21:41.864611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:41.865161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:41.884382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.884698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:41.894082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:41.894545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.127233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:42.139483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:42.141564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:42.142993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8a95f608-a7f1-43d1-b031-dfccfc553ea6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1751 microversion: 2.20 time: 0.483698 Apr 20 19:21:42.144076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 301/608] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:41 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1751 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:42.149050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lazy-loading 'services' on Instance uuid 072ef72c-8b70-4646-b698-a199605e7183 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:21:42.152293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8729a7a1-ea46-41ef-9ff2-f1abe4ff1a5b tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d0a950>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.258782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8729a7a1-ea46-41ef-9ff2-f1abe4ff1a5b tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 200 len: 345 microversion: 2.1 time: 0.110350 Apr 20 19:21:42.259678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 302/609] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:21:42 2021] GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:42.271511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.272492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:42.281321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.281853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.282867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.283175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.307648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7e45b5bc-bce9-4e42-8b54-10d17dbf3df5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-volume_attachments/2cd164fc-b647-4606-8d08-65427d5d903e" status: 202 len: 0 microversion: 2.1 time: 0.446919 Apr 20 19:21:42.308678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 308/610] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:21:41 2021] DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/os-volume_attachments/2cd164fc-b647-4606-8d08-65427d5d903e => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:21:42.326576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9ba407ad-d322-4bf2-bb84-8da2b4b961ee tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Action: 'create', calling method: .version_select at 0x7fd8e038a840>, body: {"snapshot": {"volume_id": "2a893d50-eb91-4289-8465-aab704fb0db0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1644865574"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:42.733680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:42.745239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7778fefd-e774-4928-960f-d0c68a84fc0d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1357 microversion: 2.1 time: 0.479452 Apr 20 19:21:42.750242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 303/611] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:42 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1357 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:42.764837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.768075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eed22536-36ea-4a58-9a50-f724b719ad55] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:42.777366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.787141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.788075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.788581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.825595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9ba407ad-d322-4bf2-bb84-8da2b4b961ee tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.515570 Apr 20 19:21:42.826432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 309/612] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Apr 20 19:21:42 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:42.838469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ac6934eb-fe35-4be2-af24-8ecc3db54077 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0142bf8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.896923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] HTTP exception thrown: Instance eed22536-36ea-4a58-9a50-f724b719ad55 could not be found. Apr 20 19:21:42.898625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Returning 404 to user: Instance eed22536-36ea-4a58-9a50-f724b719ad55 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:42.900275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1620a4bb-4930-4959-b460-8b11b6ae2515 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55" status: 404 len: 111 microversion: 2.1 time: 0.148031 Apr 20 19:21:42.900275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 304/613] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:42 2021] GET /compute/v2.1/servers/eed22536-36ea-4a58-9a50-f724b719ad55 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:42.916358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ac6934eb-fe35-4be2-af24-8ecc3db54077 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.083153 Apr 20 19:21:42.916991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 310/614] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:42 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:42.919634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.920284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:42.927495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-40874bc5-7e12-48e1-9e3f-78666c6340b4 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d37ae8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:42.959948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.960458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:42.961323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:42.961818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.030302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-40874bc5-7e12-48e1-9e3f-78666c6340b4 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.106673 Apr 20 19:21:43.030939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 311/615] 10.222.0.48 () {58 vars in 1130 bytes} [Tue Apr 20 19:21:42 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:43.042565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ec3f98a1-2632-4cf6-b3a9-48d46e6223bb tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d37e18>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:43.155119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:21:43.182892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ec3f98a1-2632-4cf6-b3a9-48d46e6223bb tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.145298 Apr 20 19:21:43.183751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 312/616] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:43 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:43.189890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:43.192299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:43.217903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.218695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.219864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.220524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.440413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b151c1b2-828f-4fd8-adb4-c893470ac121 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 204 len: 0 microversion: 2.1 time: 0.534569 Apr 20 19:21:43.445542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 305/617] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:21:42 2021] DELETE /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:21:43.457500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:43.458646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:43.474201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.474723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.478698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.479221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.590840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:43.601754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:43.603436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:43.605110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f8de87dc-3201-4aab-a10a-5dd86d823d25 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.420002 Apr 20 19:21:43.606127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 313/618] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:43 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:43.830770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Action: 'create', calling method: .version_select at 0x7fd8e038a7b8>, body: {"keypair": {"name": "tempest-TestShelveInstance-2093278997"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:43.855342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for project 0d968355d63345bb88225895ff82e482. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:43.859693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for user 491f755244a7431eaa5670a470d58ee7 and project 0d968355d63345bb88225895ff82e482. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:43.875287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:43.889153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-66e8b2cf-5b2d-45df-88f7-726c7e90e154 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.441946 Apr 20 19:21:43.892154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 306/619] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:43 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:43.905711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:43.906425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:43.928827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.929519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:43.931865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:43.932408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.294773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:44.307575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4189590b-5ab7-480f-a0c3-0102c9631aed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1548 microversion: 2.1 time: 0.413104 Apr 20 19:21:44.308234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 307/620] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:43 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1548 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:44.313939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d0ba73bb-bf40-4b23-a679-dc8fa0ded597 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d12d90>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:44.394038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for project 0d968355d63345bb88225895ff82e482. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:44.399803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for user 491f755244a7431eaa5670a470d58ee7 and project 0d968355d63345bb88225895ff82e482. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:44.415363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21fac032-088a-4e05-b38f-a3874ea912a1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.724427 Apr 20 19:21:44.418774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d0ba73bb-bf40-4b23-a679-dc8fa0ded597 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.108842 Apr 20 19:21:44.419009 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 314/621] 10.222.0.48 () {60 vars in 1148 bytes} [Tue Apr 20 19:21:43 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:44.419954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 308/622] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:44 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:44.425884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:44.426923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:44.436187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.436687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.437555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.438095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.625779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:44.626484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:44.648561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.649070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.649949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.650591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.688754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:44.699660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0c7bf71b-9719-4432-8724-59f6a0d5c58d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1548 microversion: 2.1 time: 0.278253 Apr 20 19:21:44.700918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 309/623] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:44 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:44.734286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:44.739169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:44.739169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:21:44.741711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:44.742584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Searching by: {'deleted': False, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696'} {{(pid=100515) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 20 19:21:44.763802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.764340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.765565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:44.766094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:44.923453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.multi_cell_list [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100515) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 20 19:21:45.102041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d0599a36-ba7a-4c17-8510-19c9a03c5880 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.371734 Apr 20 19:21:45.102615 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 310/624] 10.222.0.48 () {58 vars in 1115 bytes} [Tue Apr 20 19:21:44 2021] GET /compute/v2.1/servers => generated 342 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:45.125163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:45.126240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:45.146860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:45.148633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:45.149366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:45.150758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:45.151559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:45.173874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:45.175579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:45.176841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3800adcb-62ce-4a03-84e3-27f338ca552b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.555990 Apr 20 19:21:45.177470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 315/625] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:44 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:45.210655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:45.211347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:45.239793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:45.240702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:45.241789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:45.242518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:45.635880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:45.649457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-94d71a58-d67b-4827-b192-1ba94852a7bc tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1548 microversion: 2.1 time: 0.444880 Apr 20 19:21:45.651848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 316/626] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:45 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1548 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:45.656901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5e9bbc87-6dbc-43b5-868a-5cfd344bd6e1 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d37730>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:45.696945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:45.719868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3d21666b-3ce8-4214-905e-6f4a07d819d8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.616083 Apr 20 19:21:45.723897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 311/627] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:45 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:45.762163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5e9bbc87-6dbc-43b5-868a-5cfd344bd6e1 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.109062 Apr 20 19:21:45.762804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 317/628] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:45 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:46.196757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:46.197666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:46.212339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:46.212856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:46.213771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:46.214298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:46.642466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:46.655484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:46.657155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:46.658640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b4e1e7db-12f5-4ed4-8c21-19b402d4e332 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.465914 Apr 20 19:21:46.659342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 312/629] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:46 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:46.741249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:46.742031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:46.756084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:46.756581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:46.757446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:46.757948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:46.775310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4e85bf59-2f62-4893-accd-8b2b885d1608 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e00e50d0>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:46.881223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4e85bf59-2f62-4893-accd-8b2b885d1608 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.109796 Apr 20 19:21:46.882351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 313/630] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:46 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:47.063482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:47.073544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3a206d62-4988-4d46-8953-9ab1ea1d5bd9 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.336319 Apr 20 19:21:47.079482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 318/631] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:46 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:47.679007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:47.679676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:47.693948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:47.695368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:47.696651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:47.706886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:47.893809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a54d747f-7b74-418c-9ab7-750f67ddb76e tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e038ab70>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:47.954196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a54d747f-7b74-418c-9ab7-750f67ddb76e tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.064835 Apr 20 19:21:47.955060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 319/632] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:47 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:48.104815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:48.105895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:48.131043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:48.131846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:48.136737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:48.137499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:48.419642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:48.440555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:48.446849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:48.450390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fc1c996e-0aec-4c3c-8a1a-87c39a0ad16e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.775513 Apr 20 19:21:48.454157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 314/633] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:47 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:48.571649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:48.581188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3307756f-5cbc-4e4e-8e77-b3c94e664ee6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.488208 Apr 20 19:21:48.581817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 320/634] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:48 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:48.967582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-67a83708-687a-438a-a907-484d2df3d898 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e01399d8>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:49.025210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-67a83708-687a-438a-a907-484d2df3d898 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.061785 Apr 20 19:21:49.026783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 315/635] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:48 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:49.478373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:49.479096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:49.487300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:49.493014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:49.493014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:49.493014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:49.607368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:49.608421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:49.631504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:49.634981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:49.636000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:49.636927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:49.902595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:49.913606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:49.915358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:49.916692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-52dbfd1a-e2e0-49c8-8ded-d3a0e14186cc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.442561 Apr 20 19:21:49.917447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 321/636] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:49 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:50.001687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:50.011894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-434797a3-0343-4315-9b72-eb587efb21a6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.408646 Apr 20 19:21:50.012877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 316/637] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:49 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:50.038465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3eff78f6-1880-4267-a2a0-6eeae47dfbf4 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0142840>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:50.105222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3eff78f6-1880-4267-a2a0-6eeae47dfbf4 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.070694 Apr 20 19:21:50.105895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:50 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:50.936603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:50.937488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:50.946009 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:50.946732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:50.947914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:50.948618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:51.031081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:51.032607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:51.041247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:51.042205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:51.043288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:51.043941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:51.297193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:51.310133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:51.312346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:51.314286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6cf9ab0b-616d-4961-8f4d-9c65f658f025 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.381962 Apr 20 19:21:51.318217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 317/639] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:50 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:51.323478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6fd45d81-cefa-4be3-b726-cdb206a98450 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d12730>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:51.368863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:51.372352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6fd45d81-cefa-4be3-b726-cdb206a98450 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 288 microversion: 2.1 time: 0.052737 Apr 20 19:21:51.373069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 318/640] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:51 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:51.378026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4c574de4-5583-408c-9733-325ccf3d85fa tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.351430 Apr 20 19:21:51.379050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 323/641] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:51 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:51.388518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6af7c58f-5d48-486c-ac2d-9bfbfae5165d tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e00e58c8>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:51.501954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6af7c58f-5d48-486c-ac2d-9bfbfae5165d tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 202 len: 0 microversion: 2.1 time: 0.121605 Apr 20 19:21:51.502623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 319/642] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Apr 20 19:21:51 2021] DELETE /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:21:51.512210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-380c3e65-4e10-4ada-8aa7-a1e557c83999 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0142620>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:51.564898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-380c3e65-4e10-4ada-8aa7-a1e557c83999 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.057138 Apr 20 19:21:51.565665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 324/643] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:51 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:52.341440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:52.342498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:52.356759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:52.357619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:52.359082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:52.359909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:52.397022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:52.398175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:52.407186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:52.408343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:52.409807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:52.410534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:52.708022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:52.717519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df0da069-5c54-4314-94df-437bbd9274a2 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.325158 Apr 20 19:21:52.718248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 325/644] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:52 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:52.723040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b86b7090-e72b-43c4-9b77-655c031b565f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e038a7b8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:52.724032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:52.737992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:52.740101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:52.741416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2980d5d9-63f7-4b21-9218-5febc7c242bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.407295 Apr 20 19:21:52.742133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 320/645] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:52 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:52.775614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b86b7090-e72b-43c4-9b77-655c031b565f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.056142 Apr 20 19:21:52.776236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 326/646] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:52 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:53.736309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:53.737015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:53.745258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:53.745773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:53.746659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:53.747147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:53.761245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:53.761969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:53.770928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:53.771637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:53.772490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:53.772991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:54.099285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:54.110813 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d2a8bc6b-2a1f-4c0c-851c-b08c13059bd6 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.377880 Apr 20 19:21:54.111994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 321/647] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:53 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:54.117974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5cd2cd46-e07f-40de-a622-0019ad36031d tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d12d90>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:54.122401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:54.134998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:54.136743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:54.138104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31e80ec5-f0a5-4825-b50a-1bbedd8a5d85 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.381167 Apr 20 19:21:54.139095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 327/648] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:53 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:54.195628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5cd2cd46-e07f-40de-a622-0019ad36031d tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 200 len: 287 microversion: 2.1 time: 0.081565 Apr 20 19:21:54.196284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 322/649] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:54 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:55.129819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.130690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:55.139185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.139724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:55.140560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.141051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:55.157101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.157818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:55.166255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.166771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:55.167566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.168060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:55.482113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:55.487867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-64134da6-1c62-418e-a663-3b06df7028bb tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.362765 Apr 20 19:21:55.488505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 328/650] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:55 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:55.504460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3b6ebec3-feca-4f73-84c0-d72e09a99873 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d37ae8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.512306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:55.531213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:55.533612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:55.534953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-334403e1-9651-44af-9ce7-3ca0a652727d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.382019 Apr 20 19:21:55.536035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 323/651] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:55 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:55.554708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-3b6ebec3-feca-4f73-84c0-d72e09a99873 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] HTTP exception thrown: Snapshot 3fe33403-66e1-4e23-b5ce-d9401d168155 could not be found. Apr 20 19:21:55.555386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3b6ebec3-feca-4f73-84c0-d72e09a99873 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Returning 404 to user: Snapshot 3fe33403-66e1-4e23-b5ce-d9401d168155 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:55.556302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3b6ebec3-feca-4f73-84c0-d72e09a99873 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155" status: 404 len: 111 microversion: 2.1 time: 0.056096 Apr 20 19:21:55.557052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 329/652] 10.222.0.48 () {58 vars in 1241 bytes} [Tue Apr 20 19:21:55 2021] GET /compute/v2.1/os-snapshots/3fe33403-66e1-4e23-b5ce-d9401d168155 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:55.565822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0713e623-8a58-4a83-87e3-fe675966e3cc tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e00e51e0>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.606766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-137990834", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "networks": [{"uuid": "caf71d8f-22e3-4252-8fc9-b332e3720796"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:55.665695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0713e623-8a58-4a83-87e3-fe675966e3cc tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 202 len: 0 microversion: 2.1 time: 0.103689 Apr 20 19:21:55.666377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 324/653] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:21:55 2021] DELETE /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:21:55.674693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2319e1af-4adf-4f1a-bdee-4f0ea2e593b8 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0139e18>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.702550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] validate_networks() for [('caf71d8f-22e3-4252-8fc9-b332e3720796', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:21:55.773941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2319e1af-4adf-4f1a-bdee-4f0ea2e593b8 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 200 len: 344 microversion: 2.1 time: 0.102956 Apr 20 19:21:55.774803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 325/654] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:21:55 2021] GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:55.787209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9de2661-f021-44df-a9f2-fd9fbda67b80"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:55.788584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:55.797481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.798120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:55.799035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:55.799606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.250693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8599ad5b-d51f-41eb-b4a7-e6e43dc0b8d9 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466926 Apr 20 19:21:56.251846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 326/655] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:21:55 2021] POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:56.278876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:21:56.279529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:21:56.280217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:21:56.280828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:21:56.281475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:21:56.293429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.294334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.295437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.296154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.323273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Getting quotas for project 7be22f2bc47d4b77ad6ca95a8e026bbb. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:21:56.328164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Getting quotas for user d9684ccb65b641b9b5906114b428ae4a and project 7be22f2bc47d4b77ad6ca95a8e026bbb. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:21:56.340018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:21:56.342676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:21:56.397113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-549b562e-fb71-4287-8d20-884a24638d9a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792743 Apr 20 19:21:56.409324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9e1217d7-2087-4583-8906-a2b8117f44ab tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:56.410037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9e1217d7-2087-4583-8906-a2b8117f44ab tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:56.414083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 330/656] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:21:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:21:56.506484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:56.507151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:56.511397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9e1217d7-2087-4583-8906-a2b8117f44ab tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:56.521494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.525000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9e1217d7-2087-4583-8906-a2b8117f44ab tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1218 microversion: 2.1 time: 0.120215 Apr 20 19:21:56.535802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 327/657] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:56 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:21:56.537251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.539381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.550233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.555044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:56.556233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:56.566817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.567330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.568181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:56.568671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:56.975002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:56.983530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:56.988505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a9f70d2a-5628-4624-ae17-147cc704d817 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.486040 Apr 20 19:21:56.993519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 331/658] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:56 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:57.001742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4f3cd659-74f8-4769-904e-2cddfe3aff04 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:57.004861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:57.011112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:57.012728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c7dfb5b6-f6c5-4bea-901a-faccc333801a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.461782 Apr 20 19:21:57.024994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f3cd659-74f8-4769-904e-2cddfe3aff04 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:57.024994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4f3cd659-74f8-4769-904e-2cddfe3aff04 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:57.025317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 328/659] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:56 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:57.027954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ae92d5f7-8955-4456-bff0-360aedf81ebf tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e0d4cc80>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:57.087282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4f3cd659-74f8-4769-904e-2cddfe3aff04 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Going to try to stop instance {{(pid=100514) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 19:21:57.139497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-ae92d5f7-8955-4456-bff0-360aedf81ebf tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] HTTP exception thrown: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. Apr 20 19:21:57.140607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ae92d5f7-8955-4456-bff0-360aedf81ebf tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Returning 404 to user: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:57.141723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ae92d5f7-8955-4456-bff0-360aedf81ebf tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 404 len: 109 microversion: 2.1 time: 0.118672 Apr 20 19:21:57.142627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 329/660] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:21:57 2021] GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:57.167300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-348790cf-ea96-4124-b544-cbc7f0185d00 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e02740d0>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:57.178010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4f3cd659-74f8-4769-904e-2cddfe3aff04 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 202 len: 0 microversion: 2.1 time: 0.182844 Apr 20 19:21:57.178643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 332/661] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:21:56 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:21:57.195091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:57.196053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:57.208626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:57.209095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:57.209972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:57.212251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:57.234621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-348790cf-ea96-4124-b544-cbc7f0185d00 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] HTTP exception thrown: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. Apr 20 19:21:57.235561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-348790cf-ea96-4124-b544-cbc7f0185d00 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Returning 404 to user: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:57.236620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-348790cf-ea96-4124-b544-cbc7f0185d00 tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 404 len: 109 microversion: 2.1 time: 0.081669 Apr 20 19:21:57.237386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 330/662] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:21:57 2021] DELETE /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:57.245881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9212e2ea-af8e-45d8-a07e-14a12869a56f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Calling method '.version_select at 0x7fd8e1603400>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:57.318995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-9212e2ea-af8e-45d8-a07e-14a12869a56f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] HTTP exception thrown: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. Apr 20 19:21:57.319671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9212e2ea-af8e-45d8-a07e-14a12869a56f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] Returning 404 to user: Volume 2a893d50-eb91-4289-8465-aab704fb0db0 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:21:57.320579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9212e2ea-af8e-45d8-a07e-14a12869a56f tempest-VolumesSnapshotsTestJSON-935427670 tempest-VolumesSnapshotsTestJSON-935427670-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0" status: 404 len: 109 microversion: 2.1 time: 0.078668 Apr 20 19:21:57.321189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 331/663] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:21:57 2021] GET /compute/v2.1/os-volumes/2a893d50-eb91-4289-8465-aab704fb0db0 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:21:57.480713 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:57.492309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8ee868d8-b299-4fa3-ad97-dc8df287396f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.302446 Apr 20 19:21:57.494645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 333/664] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:57 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:57.544821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:57.545500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:57.553704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:57.554341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:57.555225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:57.555722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:57.682822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:57.692136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5133c5f1-2cc2-43fb-a7ab-9b6813fc3496 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1270 microversion: 2.1 time: 0.152048 Apr 20 19:21:57.692728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 332/665] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:57 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:58.012253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:58.012970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:58.022699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.023321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.024275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.024832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.034139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:58.035047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:58.044438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.045140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.046300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.047152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.376106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.383104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.387106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8ba26e2b-4f26-49e9-b65a-add0a63b2bec tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.379117 Apr 20 19:21:58.387848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 334/666] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:58 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:58.403797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.405458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.406746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d93820a5-61a4-46b6-a236-886504c5400c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.377916 Apr 20 19:21:58.407355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 333/667] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:58 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:58.511838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:58.512472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:58.521778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.522506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.523775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.524421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.711317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:58.712229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:58.729619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.731006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.731949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:58.732454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:58.799662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.809727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d9a1fbe-5cc3-4b3e-be27-4e6ed2f11e03 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.301897 Apr 20 19:21:58.810536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 335/668] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:58 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:58.884968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:58.895071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-216ade62-ad18-4f1e-a5ad-dab4e11d0c08 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1276 microversion: 2.1 time: 0.188024 Apr 20 19:21:58.895583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 334/669] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:58 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:59.406122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:59.406912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:59.416779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.417353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.418563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.419138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.427636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:59.428435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:59.438847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.439360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.440607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.441105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.786123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:59.799850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fe891c4a-5a05-4406-ab48-2044244d66e4 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.398108 Apr 20 19:21:59.801543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 336/670] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:59 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:59.818000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:59.829351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:59.829843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:59.830705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:59.831939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:21:59.833371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2519f1b0-d110-4492-923c-5db56e9b3662 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.411324 Apr 20 19:21:59.834204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 335/671] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:21:59 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:21:59.842957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.843552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.844841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.845344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.920558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:59.921522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:21:59.931980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.932483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:21:59.933414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:21:59.933908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:00.144466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:00.153865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2411d51e-869a-40d3-888e-ded332610476 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.329314 Apr 20 19:22:00.155006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 337/672] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:59 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:22:00.240953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:00.250818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2a76073e-dea3-4df0-8ca6-2e174ac4687e tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.334259 Apr 20 19:22:00.251634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 336/673] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:21:59 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:00.349036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-2832dd54-9869-43ac-96ea-f6131269eede req-99a9415c-fdc8-484c-af50-03e05bca0ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f64bf26-0f44-476d-b513-2423785d8947", "tag": "8db6ba9e-5647-4f03-bf5a-87a4b20c333c"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:00.350947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:00.350947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:00.361793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2832dd54-9869-43ac-96ea-f6131269eede req-99a9415c-fdc8-484c-af50-03e05bca0ccb service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:00.362340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2832dd54-9869-43ac-96ea-f6131269eede req-99a9415c-fdc8-484c-af50-03e05bca0ccb service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:00.381730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-2832dd54-9869-43ac-96ea-f6131269eede req-99a9415c-fdc8-484c-af50-03e05bca0ccb service nova] Creating event network-changed:8db6ba9e-5647-4f03-bf5a-87a4b20c333c for instance 1f64bf26-0f44-476d-b513-2423785d8947 on hv-cinder-78693 Apr 20 19:22:00.388838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-2832dd54-9869-43ac-96ea-f6131269eede req-99a9415c-fdc8-484c-af50-03e05bca0ccb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Apr 20 19:22:00.388838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 338/674] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:00.822213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:00.822729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:00.830892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:00.831539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:00.833261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:00.833968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:00.854185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:00.854998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:00.872270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:00.872869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:00.873926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:00.874525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:01.265899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.277314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.291873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-73bfa920-f287-4aaf-8c92-050ab4792602 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.473703 Apr 20 19:22:01.293885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.294705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 337/675] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:00 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:01.299555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.301010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6c562449-1369-446b-bc03-9a1a55eb45cd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.451490 Apr 20 19:22:01.303525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:01.303834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 339/676] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:00 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:01.305708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:01.312028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:01.314350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:01.321519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:01.324294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:01.325242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:01.325734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:01.337603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:01.338127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:01.339079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:01.339569 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:01.831362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.838160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:01.841515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cd6a31cd-cfa8-4dac-bf8d-0a94f7914971 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.536443 Apr 20 19:22:01.842431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 340/677] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:01 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:01.874518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6ee55401-6aa5-43be-98a2-1dbabfb34ad5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.577823 Apr 20 19:22:01.879179 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 338/678] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:01 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:02.324310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:02.324543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:02.324972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:02.326024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:02.333295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:02.333991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:02.335150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:02.335641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:02.336365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:02.337235 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:02.338477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:02.339356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.006517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.012806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.019804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5d4c68b1-e04f-49fd-946d-738c7dd4c874 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1522 microversion: 2.1 time: 0.699091 Apr 20 19:22:03.020668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 341/679] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:02 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1522 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:03.024243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.025928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.026912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:03.027425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f682e9e3-365b-4a3d-af40-0159f98c1437 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.707372 Apr 20 19:22:03.027978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 339/680] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:02 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:03.028866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:03.033316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:03.034207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:03.042358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:03.043094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.044111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:03.044774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.053561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:03.053941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.055193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:03.055857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.572299 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.575342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:03.582997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-658a9fa8-743c-4069-99ad-cd8e04bda61a tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.560823 Apr 20 19:22:03.583693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 342/681] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:03 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:03.585255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-127c8eef-cd58-4d69-b7f7-459fb28bce8b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.556010 Apr 20 19:22:03.585903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 340/682] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:03 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:03.589383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-8633e8ac-cbaf-4de1-8c60-07a8f4222cd9 req-c2c0a74f-8020-4f5f-8374-0547ddb3013a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb06c1b0-0d59-4ae0-a487-4fa1252de8e1", "name": "network-vif-deleted", "tag": "25a065c9-4997-4b1c-8cf3-f66d5c392d3a"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:03.591256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:03.591256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:03.600536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8633e8ac-cbaf-4de1-8c60-07a8f4222cd9 req-c2c0a74f-8020-4f5f-8374-0547ddb3013a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:03.601035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8633e8ac-cbaf-4de1-8c60-07a8f4222cd9 req-c2c0a74f-8020-4f5f-8374-0547ddb3013a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:03.618485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-8633e8ac-cbaf-4de1-8c60-07a8f4222cd9 req-c2c0a74f-8020-4f5f-8374-0547ddb3013a service nova] Creating event network-vif-deleted:25a065c9-4997-4b1c-8cf3-f66d5c392d3a for instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 on hv-cinder-78693 Apr 20 19:22:03.623683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-8633e8ac-cbaf-4de1-8c60-07a8f4222cd9 req-c2c0a74f-8020-4f5f-8374-0547ddb3013a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038562 Apr 20 19:22:03.624319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 343/683] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:04.039974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:04.040760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:04.058790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:04.059830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:04.079665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.080219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.081107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.081599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.083821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.084338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.085217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.085711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.251152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.253340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.254104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lazy-loading 'fault' on Instance uuid eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:22:04.432266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.441296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710470ea975e45cc95d3fc679abb6cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d47d9888e1a44e59e046c5da416e68d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.444679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.447891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.449648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e87992fe-d900-4060-8e12-41301219b921 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.403485 Apr 20 19:22:04.450344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f128bb80-9adf-400c-baf6-0489344316c8 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 200 len: 1311 microversion: 2.1 time: 0.414261 Apr 20 19:22:04.451379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 341/684] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:04 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 1311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:04.459616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 344/685] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:04 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:04.601563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:04.602269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:04.605603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:04.606981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:04.610529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.611204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.612217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.612853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.617223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.617924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.619215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.619780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.958006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.962208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:04.968056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2ca056e8-1d11-4002-8ee9-40005990438c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.367664 Apr 20 19:22:04.968772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 345/686] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:04 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:04.973749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:04.974545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:04.980857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bb249d9d-032f-46b3-9d2c-89a620e570da tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.383708 Apr 20 19:22:04.981504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 342/687] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:04 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:04.990143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.990954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:04.991801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:04.992291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.221973 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:05.231698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4dd6ce1f-043b-410b-aa2c-eb6abb92b00e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1594 microversion: 2.1 time: 0.261585 Apr 20 19:22:05.232582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 346/688] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:04 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1594 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:05.470577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:05.470764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:05.471244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] [instance: eb06c1b0-0d59-4ae0-a487-4fa1252de8e1] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:05.471443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:05.484660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.485162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.486379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.486873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.490414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.491138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.492139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.492773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.567815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] HTTP exception thrown: Instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 could not be found. Apr 20 19:22:05.569030 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] Returning 404 to user: Instance eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:05.570309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a1afe8e1-0152-4ec2-b63d-b46ab82b8cd1 tempest-ServerRescueNegativeTestJSON-461614400 tempest-ServerRescueNegativeTestJSON-461614400-project] 10.222.0.48 "GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1" status: 404 len: 111 microversion: 2.1 time: 0.104615 Apr 20 19:22:05.571803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 343/689] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:05 2021] GET /compute/v2.1/servers/eb06c1b0-0d59-4ae0-a487-4fa1252de8e1 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:22:05.987054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:05.987637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:05.995845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.996350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:05.997163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:05.997859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:06.140467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:06.152866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:06.154725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:06.156092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dd6ad4bf-9f51-4641-817e-ff268e14e86d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.690294 Apr 20 19:22:06.156676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 347/690] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:05 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:06.162582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:06.163463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:06.172592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:06.173171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:06.174119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:06.174680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:06.845456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:06.857754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-75670a20-bbd1-478d-84ba-190209fd6a8e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1678 microversion: 2.1 time: 0.874806 Apr 20 19:22:06.869594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 344/691] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:05 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1678 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:22:06.881391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-629c213f-1e5e-4671-83e2-24ab3a7ca41d req-018f629b-5f7d-4cf7-96e5-e0227cb426c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f64bf26-0f44-476d-b513-2423785d8947", "name": "network-vif-plugged", "status": "completed", "tag": "8db6ba9e-5647-4f03-bf5a-87a4b20c333c"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:06.883236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:06.883236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:06.894810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-629c213f-1e5e-4671-83e2-24ab3a7ca41d req-018f629b-5f7d-4cf7-96e5-e0227cb426c1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:06.895546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-629c213f-1e5e-4671-83e2-24ab3a7ca41d req-018f629b-5f7d-4cf7-96e5-e0227cb426c1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:06.915853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-629c213f-1e5e-4671-83e2-24ab3a7ca41d req-018f629b-5f7d-4cf7-96e5-e0227cb426c1 service nova] Creating event network-vif-plugged:8db6ba9e-5647-4f03-bf5a-87a4b20c333c for instance 1f64bf26-0f44-476d-b513-2423785d8947 on hv-cinder-78693 Apr 20 19:22:06.922685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-629c213f-1e5e-4671-83e2-24ab3a7ca41d req-018f629b-5f7d-4cf7-96e5-e0227cb426c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047976 Apr 20 19:22:06.923958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 345/692] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:06.930787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1341827624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2093278997", "security_groups": [{"name": "tempest-secgroup-smoke-476646397"}], "networks": [{"uuid": "445fed4f-33bd-4f88-a026-875f56e6427b"}], "block_device_mapping_v2": [{"uuid": "30e096c6-d6ed-4bc4-b06f-88d164be20c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:06.936059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:06.950817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f195f3ca-89fc-4785-85d8-8c5cac1de2b5 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.790957 Apr 20 19:22:06.962702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 348/693] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:06 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:07.175200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:07.176231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:07.184873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:07.185675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:07.186801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:07.187484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:07.439210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] validate_networks() for [('445fed4f-33bd-4f88-a026-875f56e6427b', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:22:07.866166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:07.885431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:07.887993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:07.889595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-518930e5-3746-4548-8cf7-d4ceecf53251 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.718614 Apr 20 19:22:07.890531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 349/694] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:07 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:22:07.895535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:07.896211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:07.905741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:07.906478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:07.907539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:07.908210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:08.584979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:08.607567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6072067a-af6c-4d53-9859-3be3f89039b2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1655 microversion: 2.1 time: 0.707960 Apr 20 19:22:08.608835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 350/695] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:07 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1655 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:08.615878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:08.616680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:08.625500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:08.626108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:08.627867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:08.628718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.547201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:09.557472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:22:09.558366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:22:09.559041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:22:09.559172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-228fac64-4443-4060-8401-a233c31698dd tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1318 microversion: 2.1 time: 0.948819 Apr 20 19:22:09.559948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 351/696] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:08 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:09.560245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:22:09.560890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:22:09.565946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a285f400-43a8-4348-a380-5418f6550027 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:09.576526 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.576886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.577766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.578301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.591690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a285f400-43a8-4348-a380-5418f6550027 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.594219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a285f400-43a8-4348-a380-5418f6550027 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.623950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for project 0d968355d63345bb88225895ff82e482. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:22:09.632001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Getting quotas for user 491f755244a7431eaa5670a470d58ee7 and project 0d968355d63345bb88225895ff82e482. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:22:09.671802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a285f400-43a8-4348-a380-5418f6550027 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Going to try to start instance {{(pid=100514) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 19:22:09.855737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a285f400-43a8-4348-a380-5418f6550027 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action" status: 202 len: 0 microversion: 2.1 time: 0.293921 Apr 20 19:22:09.857494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 352/697] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:22:09 2021] POST /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:22:09.869324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-30dec73d-766f-410e-960c-a3cbfeefe9be req-dbfde2a0-e4e4-479b-9cee-c3bc830c9fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:09.871098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:22:09.871455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:09.871455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:09.873810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30e096c6-d6ed-4bc4-b06f-88d164be20c5',volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:22:09.888891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-30dec73d-766f-410e-960c-a3cbfeefe9be req-dbfde2a0-e4e4-479b-9cee-c3bc830c9fb6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.889510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-30dec73d-766f-410e-960c-a3cbfeefe9be req-dbfde2a0-e4e4-479b-9cee-c3bc830c9fb6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.929870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-30dec73d-766f-410e-960c-a3cbfeefe9be req-dbfde2a0-e4e4-479b-9cee-c3bc830c9fb6 service nova] Creating event network-changed:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:22:09.941306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-30dec73d-766f-410e-960c-a3cbfeefe9be req-dbfde2a0-e4e4-479b-9cee-c3bc830c9fb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081796 Apr 20 19:22:09.947800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 353/698] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:09.965302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:09.966351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:09.981596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.985662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:09.986685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:09.987258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:10.247250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-12dc2200-c2fe-4cb0-a2e1-fecc3ca02287 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.321790 Apr 20 19:22:10.253971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 346/699] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:22:06 2021] POST /compute/v2.1/servers => generated 405 bytes in 3329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:22:10.279320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-75a24309-2762-4db8-b29b-18d776225d98 req-40cb9128-121e-44c7-919d-61ad96856495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "name": "network-vif-plugged", "status": "completed", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:10.281745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:10.281745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:10.293239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-75a24309-2762-4db8-b29b-18d776225d98 req-40cb9128-121e-44c7-919d-61ad96856495 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:10.294096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-75a24309-2762-4db8-b29b-18d776225d98 req-40cb9128-121e-44c7-919d-61ad96856495 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:10.314285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-75a24309-2762-4db8-b29b-18d776225d98 req-40cb9128-121e-44c7-919d-61ad96856495 service nova] Creating event network-vif-plugged:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:22:10.320290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-75a24309-2762-4db8-b29b-18d776225d98 req-40cb9128-121e-44c7-919d-61ad96856495 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059817 Apr 20 19:22:10.321247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 347/700] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:10.327909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:10.328879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:10.337745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:10.338867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:10.339947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:10.340660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:10.898462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:10.928123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:10.929807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:10.931113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-13b7f694-6ca1-4192-8e60-9d103877db6e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 0.982288 Apr 20 19:22:10.931912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 354/701] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:09 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:10.938209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:10.940653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:10.961389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:10.962923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:10.963957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:10.964942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:11.378352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:11.391513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b1e537cb-230c-42eb-ac50-b7d819b8275f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1139 microversion: 2.1 time: 0.457093 Apr 20 19:22:11.392792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 355/702] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:10 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1139 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:11.406965 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:11.407724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:11.410199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:11.416288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:11.416824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:11.417688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:11.418362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:11.429712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e678e411-691e-40ee-9efd-74225e03b451 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1664 microversion: 2.1 time: 1.106876 Apr 20 19:22:11.430692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 348/703] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:10 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1664 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:11.467685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-794385002"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:11.468280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:11.480764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:11.481291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:11.482167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:11.482645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:12.436865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:12.446193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d38b7b50-d300-4205-86e7-2e7df365910d tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1506 microversion: 2.1 time: 1.051929 Apr 20 19:22:12.458427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 356/704] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:11 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1506 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:12.473483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:12.482018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:12.499193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:12.499193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:12.499193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:12.499193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:12.729405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.network.security_group_api [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Adding security group b1371fb9-f4d2-40a3-b24a-148e95b9c216 to port 79ce51e3-8bf1-4b3e-acb6-946d6604e11f Apr 20 19:22:13.821649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:13.837754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:13.839955 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:13.841938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3ff82de9-e4d6-418c-997d-1d218bf81165 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1807 microversion: 2.20 time: 1.381906 Apr 20 19:22:13.842731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 357/705] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:12 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1807 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:13.848539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:13.849257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:13.857535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:13.858322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:13.859332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:13.859971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:14.845599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:14.863895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ff5abb25-d3df-4bf9-b1e2-d098e9a34bce tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 1.017959 Apr 20 19:22:14.864587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 358/706] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:13 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:14.881057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:14.881730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:14.896590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:14.905368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:14.906534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:14.907178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:14.922336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4abf7021-b30c-44b1-8204-6a6496aa7b86 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action" status: 202 len: 0 microversion: 2.1 time: 3.458677 Apr 20 19:22:14.924396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 349/707] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:22:11 2021] POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action => generated 0 bytes in 3461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:22:14.930182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d21e05b-119c-40c1-bd2c-0c4d304a6178", "device": "/dev/sdb"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:14.937614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:14.958085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:14.959065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:14.960057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:14.962088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:15.507367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:15.518567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cc5f6bd8-80a1-417d-a7db-d8bbe09b11a0 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1668 microversion: 2.1 time: 0.652768 Apr 20 19:22:15.519154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 359/708] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:14 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1668 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:15.538619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:15.539288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:15.547424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:15.548043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:15.548887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:15.549377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:15.729588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-91b54c72-8b69-43df-b098-70aab7c0aec6 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "POST /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803658 Apr 20 19:22:15.732376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 350/709] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:22:14 2021] POST /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:15.770646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:15.777395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:15.797504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:15.797803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:15.798706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:15.799199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:16.490170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:16.508528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:16.523953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-68fa7392-898d-4aad-9b6f-35cbb40d6efa tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1758 microversion: 2.1 time: 0.766201 Apr 20 19:22:16.525205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:16.527288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:16.528805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 351/710] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:15 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1758 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:16.532683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-165af896-eaa3-4359-bbaa-4b2973389064 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1794 microversion: 2.20 time: 0.998313 Apr 20 19:22:16.534230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 360/711] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:22:15 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1794 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:16.537737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-181ee6f7-7896-4ebd-9f84-d4c0294bb95e req-23601b93-2b98-4d9c-8180-aaf0f65de0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:16.543841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:16.543841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:16.545972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-2712abe8-0145-4c0c-9268-deb4422f35c7 req-f2734f48-2b24-4a20-8838-3aac2c17be03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:16.549918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:16.549918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:16.592253 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-181ee6f7-7896-4ebd-9f84-d4c0294bb95e req-23601b93-2b98-4d9c-8180-aaf0f65de0ae service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:16.593103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-181ee6f7-7896-4ebd-9f84-d4c0294bb95e req-23601b93-2b98-4d9c-8180-aaf0f65de0ae service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:16.596529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2712abe8-0145-4c0c-9268-deb4422f35c7 req-f2734f48-2b24-4a20-8838-3aac2c17be03 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:16.597324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2712abe8-0145-4c0c-9268-deb4422f35c7 req-f2734f48-2b24-4a20-8838-3aac2c17be03 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:16.616095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-181ee6f7-7896-4ebd-9f84-d4c0294bb95e req-23601b93-2b98-4d9c-8180-aaf0f65de0ae service nova] Creating event network-changed:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:22:16.625565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-2712abe8-0145-4c0c-9268-deb4422f35c7 req-f2734f48-2b24-4a20-8838-3aac2c17be03 service nova] Creating event network-changed:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:22:16.634662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-2712abe8-0145-4c0c-9268-deb4422f35c7 req-f2734f48-2b24-4a20-8838-3aac2c17be03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095012 Apr 20 19:22:16.635764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 361/712] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:16.637027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-181ee6f7-7896-4ebd-9f84-d4c0294bb95e req-23601b93-2b98-4d9c-8180-aaf0f65de0ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106728 Apr 20 19:22:16.637699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 352/713] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:16.643107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:16.644375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:16.656888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:16.657656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:16.659141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:16.660234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:17.212663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:17.222235 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-65aea2da-bb3a-45da-914d-aeecc2d95053 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.584826 Apr 20 19:22:17.222864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 362/714] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:16 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:18.241684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:18.242588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:18.251272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:18.251855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:18.252695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:18.253165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:18.622115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:18.631783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-503de336-2bff-4f96-a966-4a2bb2650e18 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.394915 Apr 20 19:22:18.632447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 353/715] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:18 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:19.650736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:19.651413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:19.659285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:19.659794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:19.660628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:19.661116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:19.876247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:19.886071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-440a66ca-8af8-462a-835c-d2e75b1860dd tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.239453 Apr 20 19:22:19.886671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 363/716] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:19 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:20.904683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:20.905313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:20.913675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:20.914228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:20.915082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:20.915581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:21.141685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:21.151482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5cad83fa-f9d7-4421-aa63-cd594e73b178 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.251010 Apr 20 19:22:21.160922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 354/717] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:20 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:22.169281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:22.169975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:22.178909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:22.179366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:22.180431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:22.180926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:22.399516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:22.408584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84e4aab9-26ed-4014-a17c-4515662bbe2b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.243463 Apr 20 19:22:22.409266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 364/718] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:22 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:23.426033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:23.426710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:23.435284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:23.435800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:23.436640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:23.437149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:23.654337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:23.664879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-eda7ceaf-669f-4293-a94c-5e1582387dda tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.242732 Apr 20 19:22:23.665874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 355/719] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:23 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:24.683658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:24.684403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:24.692707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:24.693211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:24.694085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:24.694578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:25.024144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:25.033302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-95f37e69-2e7f-47f5-b1b5-f1344ddd55ac tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.353761 Apr 20 19:22:25.034190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 365/720] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:24 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:26.054060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:26.055716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:26.075596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:26.076069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:26.077142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:26.077617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:26.319377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:26.330203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-efa4319d-fef4-4a00-902c-5f3d0475818f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.281302 Apr 20 19:22:26.331545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 356/721] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:26 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:27.350149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:27.350919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:27.358937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:27.359461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:27.360307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:27.360800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:27.590475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:27.599628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a8585f94-acb5-4e43-ad62-1db8dbcbea32 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.254485 Apr 20 19:22:27.600237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 366/722] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:27 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:28.622586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:28.623770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:28.637748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:28.638720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:28.640112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:28.640935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:28.865701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:28.880103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8806602d-b385-4d94-8cfc-180d4cc92c46 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.264292 Apr 20 19:22:28.881096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 357/723] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:28 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:29.899136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:29.900353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:29.908728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:29.909438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:29.910350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:29.910844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:30.132054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:30.141559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-42c2def9-d483-4612-a800-11ffa8a06b07 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.246544 Apr 20 19:22:30.142215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 367/724] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:29 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:31.161164 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:31.161887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:31.170408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:31.170920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:31.171750 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:31.172247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:31.571756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:31.581021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ed205b2f-61f6-4ad0-9390-02f1c4a40aa8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.424155 Apr 20 19:22:31.581659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 358/725] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:31 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:32.599951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:32.600673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:32.609371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:32.609902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:32.610730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:32.611214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:32.881339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:32.891203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b9da90dc-f16d-464d-ac0b-7eff4e191b17 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.295429 Apr 20 19:22:32.891833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 368/726] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:32 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:33.332036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-4932bb15-5000-40ef-b7ef-6e155d83fb4c req-a0ab5cfc-6736-4b69-b752-855866e86cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "name": "network-vif-plugged", "status": "completed", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:33.333952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:33.333952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:33.343429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4932bb15-5000-40ef-b7ef-6e155d83fb4c req-a0ab5cfc-6736-4b69-b752-855866e86cfe service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:33.343940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4932bb15-5000-40ef-b7ef-6e155d83fb4c req-a0ab5cfc-6736-4b69-b752-855866e86cfe service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:33.362121 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-4932bb15-5000-40ef-b7ef-6e155d83fb4c req-a0ab5cfc-6736-4b69-b752-855866e86cfe service nova] Creating event network-vif-plugged:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:22:33.367534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-4932bb15-5000-40ef-b7ef-6e155d83fb4c req-a0ab5cfc-6736-4b69-b752-855866e86cfe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039731 Apr 20 19:22:33.368520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 359/727] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:33.913312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:33.914047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:33.922403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:33.922904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:33.923737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:33.924220 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:34.306046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:34.315108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ad127266-e323-479a-ad58-8de87983cdbc tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.407941 Apr 20 19:22:34.315733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 369/728] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:33 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:35.338426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:35.339347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:35.350658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:35.351342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:35.352464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:35.353132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:35.581798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:35.591245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5d6d075c-d303-42bb-99e4-11092f6e3f95 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.259788 Apr 20 19:22:35.591791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 360/729] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:35 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:36.614527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:36.615767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:36.625465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:36.626122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:36.627148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:36.627704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:36.844275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:36.858333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5b2781ff-1942-467f-bc3c-1b0fdfa96107 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.250533 Apr 20 19:22:36.859199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 370/730] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:36 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:37.879596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:37.880203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:37.888804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:37.889316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:37.890226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:37.890719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:38.114528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:38.123894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-adfa9469-e8c6-4ced-9d6c-1781897dcc41 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.248558 Apr 20 19:22:38.124538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 361/731] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:37 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:39.146869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:39.147958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:39.161215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:39.162246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:39.163095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:39.163596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:39.382198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:39.391256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5b9a2002-7ca3-47c9-a788-ee697d4f08d1 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.251261 Apr 20 19:22:39.391911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 371/732] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:39 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:40.177406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:40.179979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:40.192489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.193395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.194273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.196464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.347425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4acce0af-2583-4b81-adaf-ba195728f555 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.174250 Apr 20 19:22:40.348108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 362/733] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:22:40 2021] POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:22:40.356956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:40.357621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:40.365802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.366279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.367137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.367623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.409768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:40.410590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:40.419170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.419673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.420510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:40.420996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:40.908930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:40.918899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1529a859-ed5c-458e-87e9-457da7a3948f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1750 microversion: 2.1 time: 0.565907 Apr 20 19:22:40.919514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 372/734] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:40 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1750 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:40.937365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:40.946617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2e09205b-d1ff-44c3-8019-534e074f58a2 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1260 microversion: 2.1 time: 0.541544 Apr 20 19:22:40.947245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 363/735] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:40 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1260 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:41.939667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:41.940339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:41.948613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:41.949153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:41.950020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:41.950512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:41.965065 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:41.966129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:41.974243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:41.974720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:41.975562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:41.976138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:42.327465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:42.332550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:42.337643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7c3c5b70-23b3-43ed-9939-d12cb1f6ca63 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1750 microversion: 2.1 time: 0.403779 Apr 20 19:22:42.338570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 373/736] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:41 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1750 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:42.342654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f1779ff9-e223-4078-b364-95ae48912a36 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1443 microversion: 2.1 time: 0.381454 Apr 20 19:22:42.343400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 364/737] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:41 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1443 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:42.361307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:42.362067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:42.370435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:42.370949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:42.371786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:42.372275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:42.594718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:42.604031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6399bbe4-0d02-4516-991c-a5dd930d6311 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1443 microversion: 2.1 time: 0.248036 Apr 20 19:22:42.604835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 374/738] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:42 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1443 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:43.357352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:43.358130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:43.366425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:43.367142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:43.368110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:43.368706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:43.815703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:43.816335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:43.824925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:43.825439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:43.826321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:43.826810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:43.893763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:43.903904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-958bd01e-e502-41cb-80c9-9d62d8869037 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.551027 Apr 20 19:22:43.904648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 365/739] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:43 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:44.007423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lazy-loading 'services' on Instance uuid 1f64bf26-0f44-476d-b513-2423785d8947 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:22:44.174552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ee75f449-128b-400e-9288-fe7cf6f697d8 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947/os-volume_attachments/3d21e05b-119c-40c1-bd2c-0c4d304a6178" status: 202 len: 0 microversion: 2.1 time: 0.362882 Apr 20 19:22:44.175617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 375/740] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:22:43 2021] DELETE /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947/os-volume_attachments/3d21e05b-119c-40c1-bd2c-0c4d304a6178 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:22:44.923709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:44.924566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:44.943744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:44.944263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:44.945246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:44.945772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:45.390073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:45.400242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0b64e9f9-ed0c-476f-9962-db3f1cca2c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.480600 Apr 20 19:22:45.400938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 366/741] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:44 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:45.723476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-aff09206-c796-4c35-ab23-b5c753ef1580 req-a064367f-9bab-43fb-8507-ffdf3bc13361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:45.725216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:45.725216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:45.736711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-aff09206-c796-4c35-ab23-b5c753ef1580 req-a064367f-9bab-43fb-8507-ffdf3bc13361 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:45.737453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-aff09206-c796-4c35-ab23-b5c753ef1580 req-a064367f-9bab-43fb-8507-ffdf3bc13361 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:45.758047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-aff09206-c796-4c35-ab23-b5c753ef1580 req-a064367f-9bab-43fb-8507-ffdf3bc13361 service nova] Creating event network-changed:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:22:45.764150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-aff09206-c796-4c35-ab23-b5c753ef1580 req-a064367f-9bab-43fb-8507-ffdf3bc13361 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045119 Apr 20 19:22:45.765091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 376/742] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:46.418133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.418992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:46.434842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.435651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:46.438001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.439642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:46.591416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.592465 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:46.606739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.607315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:46.608789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.609519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:46.686612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:22:46.872890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6608e723-cf79-40b7-8e57-7c9736eeca22 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 204 len: 0 microversion: 2.1 time: 0.285808 Apr 20 19:22:46.873852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 377/743] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:22:46 2021] DELETE /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:22:46.884025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.889925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:46.906481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.908454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:46.909325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:46.909854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:47.004536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:47.018461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-388c01fa-e960-4138-8a64-1580b606c00f tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.604544 Apr 20 19:22:47.021635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 367/744] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:47.572284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:47.586332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-601779bc-7f38-4113-97bf-b98c91db35b9 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1512 microversion: 2.1 time: 0.707589 Apr 20 19:22:47.587821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 378/745] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1512 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:48.039628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.040664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:48.049613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:48.050449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:48.051642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:48.052333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:48.327494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:48.338171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0f7ba8a6-9c82-48c1-b14d-ec37bde6b533 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.302694 Apr 20 19:22:48.339468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 368/746] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:48.606191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.607243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:48.615429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:48.615930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:48.616771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:48.617251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:48.842204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:48.851626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b5b67a0a-510f-42a1-85e1-0a1a4330f191 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1512 microversion: 2.1 time: 0.250628 Apr 20 19:22:48.852333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 379/747] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:49.356868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:49.357586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:49.369361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:49.369901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:49.374922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:49.375427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:49.869704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:49.870399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:49.878654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:49.879350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:49.880546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:49.881037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:50.212928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:50.223381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-04736bd2-97d7-4b9c-9b5f-b202ef3cf2f7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.870470 Apr 20 19:22:50.224370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 369/748] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:49 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:50.363637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9684ccb65b641b9b5906114b428ae4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be22f2bc47d4b77ad6ca95a8e026bbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:50.372911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9f3121ee-37e2-4f64-ad04-1cb599c84dd4 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 200 len: 1512 microversion: 2.1 time: 0.507560 Apr 20 19:22:50.373481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 380/749] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:49 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 1512 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:50.515388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-7cb1eb32-9694-4282-817a-2f314fb99799 req-efc3b4db-ba38-4d40-9c27-2452ea93e369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f64bf26-0f44-476d-b513-2423785d8947", "name": "network-vif-deleted", "tag": "8db6ba9e-5647-4f03-bf5a-87a4b20c333c"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:50.517125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:22:50.517125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:22:50.531597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7cb1eb32-9694-4282-817a-2f314fb99799 req-efc3b4db-ba38-4d40-9c27-2452ea93e369 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:50.532100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7cb1eb32-9694-4282-817a-2f314fb99799 req-efc3b4db-ba38-4d40-9c27-2452ea93e369 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:50.552410 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-7cb1eb32-9694-4282-817a-2f314fb99799 req-efc3b4db-ba38-4d40-9c27-2452ea93e369 service nova] Creating event network-vif-deleted:8db6ba9e-5647-4f03-bf5a-87a4b20c333c for instance 1f64bf26-0f44-476d-b513-2423785d8947 on hv-cinder-78693 Apr 20 19:22:50.557532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-7cb1eb32-9694-4282-817a-2f314fb99799 req-efc3b4db-ba38-4d40-9c27-2452ea93e369 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046004 Apr 20 19:22:50.558462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 370/750] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:22:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:51.245550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:51.246258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:51.254776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:51.255281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:51.256110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:51.256633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:51.392438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:51.393212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] [instance: 1f64bf26-0f44-476d-b513-2423785d8947] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:51.401346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:51.401875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:51.402734 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:51.403224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:51.469978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] HTTP exception thrown: Instance 1f64bf26-0f44-476d-b513-2423785d8947 could not be found. Apr 20 19:22:51.470958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] Returning 404 to user: Instance 1f64bf26-0f44-476d-b513-2423785d8947 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:51.472219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b324e540-8a94-41e8-8d3a-3a731b384563 tempest-VolumesSnapshotTestJSON-63571076 tempest-VolumesSnapshotTestJSON-63571076-project] 10.222.0.48 "GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947" status: 404 len: 111 microversion: 2.1 time: 0.084418 Apr 20 19:22:51.473152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 371/751] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:51 2021] GET /compute/v2.1/servers/1f64bf26-0f44-476d-b513-2423785d8947 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:22:51.493323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:51.505803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4c1b9383-ffde-4a2a-8ae7-09199ce18395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.265950 Apr 20 19:22:51.506577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 381/752] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:51 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:52.524645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:52.525327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:52.533544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:52.534104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:52.534945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:52.535439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:52.775212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:52.788051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7bd58c55-479d-43ab-aaf9-cb6fe9c1cf99 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.267575 Apr 20 19:22:52.788682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 372/753] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:52 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:53.811487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:53.812663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:53.826483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:53.827334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:53.828720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:53.829530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:54.056447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:54.066317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c9018bf7-4508-419b-96a1-064fb62aacf5 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.261681 Apr 20 19:22:54.066924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 382/754] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:53 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:55.085268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:55.085849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:55.094449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:55.094964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:55.095810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:55.096304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:55.321034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:55.330817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c2eea34c-79f8-4ce8-9c66-baa42fdb3b6e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.249784 Apr 20 19:22:55.331547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 373/755] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:55 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:56.355089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:56.356110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:56.368072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:56.368517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:56.369344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:56.369878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:56.599195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:56.609165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0e3efc05-e2b8-4621-a1f6-3cc24ee0eaa2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.261203 Apr 20 19:22:56.609807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 383/756] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:56 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:57.627897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:57.629579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:57.637964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:57.638481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:57.639328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:57.639818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:58.012491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:58.023743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8f4e8609-7f67-46e8-a9ec-ac5dae9e1395 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.399774 Apr 20 19:22:58.024657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 374/757] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:57 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:59.043605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:59.044140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:22:59.052444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:59.052950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:59.053791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:22:59.054442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:22:59.281443 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:22:59.299073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-17944d89-99dd-4ba8-9898-9a0599a7ca3c tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.259537 Apr 20 19:22:59.299891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 384/758] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:22:59 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:00.317172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:00.317939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:00.325886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:00.326400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:00.327226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:00.327714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:00.557166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:00.567633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-412b90d4-9d7b-4306-b8e1-a638f04b02a3 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.254626 Apr 20 19:23:00.568340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 375/759] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:00 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:01.586472 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:01.587098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:01.596038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:01.596549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:01.597397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:01.597873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:01.818828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:01.832201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fc316015-49ca-45b3-95f3-1c072b6ed5ed tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.249749 Apr 20 19:23:01.841187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 385/760] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:01 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:02.851102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:02.851799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:02.859657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:02.860154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:02.860981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:02.861463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:03.078575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:03.088026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-280e67cc-6ea4-4854-9b2e-9dc316914fa7 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.241035 Apr 20 19:23:03.089200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 376/761] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:02 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:04.106832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:04.107551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:04.115621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:04.116119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:04.116953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:04.117408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:04.339555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:04.349273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9bcac2d1-b7bd-4f8d-b5a8-ea9939a9d00b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.246589 Apr 20 19:23:04.349951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 386/762] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:04 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:05.372421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:05.373411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:05.387022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:05.387851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:05.389216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:05.390113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:05.623007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:05.638067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a11244a2-11af-4b65-b092-049829bf55b2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1755 microversion: 2.1 time: 0.272473 Apr 20 19:23:05.638907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 377/763] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:05 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1755 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:06.659903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:06.661768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:06.672388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:06.672976 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:06.673943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:06.674674 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:06.899687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:06.909528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dd94179a-3193-439d-8aa9-ab45f2dd2c1b tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1758 microversion: 2.1 time: 0.253802 Apr 20 19:23:06.910146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 387/764] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:06 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1758 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:07.283307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:07.283866 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:07.292460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:07.293020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:07.293856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:07.294426 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:07.357960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:23:07.476230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-aa5768d3-39d2-4c6b-8edd-fd8b465f595c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 204 len: 0 microversion: 2.1 time: 0.196394 Apr 20 19:23:07.476971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 378/765] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:23:07 2021] DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:23:07.485937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:07.486611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:07.494881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:07.495385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:07.496264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:07.496754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:07.719978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:07.734094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-78c2f6e8-9b5d-41a3-94db-cd949924de33 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1674 microversion: 2.1 time: 0.251887 Apr 20 19:23:07.734855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 388/766] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:07 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:08.452878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:08.453540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:08.461698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.462260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.463066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.463582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.535297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-90ef188e-f7d0-43de-8b1a-e6d92c94cb3d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments/dc8cfebb-1742-4123-a364-85809769f25a" status: 200 len: 194 microversion: 2.20 time: 0.284241 Apr 20 19:23:08.535946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 379/767] 10.222.0.48 () {60 vars in 1444 bytes} [Tue Apr 20 19:23:08 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments/dc8cfebb-1742-4123-a364-85809769f25a => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:08.648388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:08.648930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:08.657039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.657546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.658448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.658944 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.755263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:08.756221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:08.764491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.764994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.765821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:08.766331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:08.835917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lazy-loading 'services' on Instance uuid b4274f79-46b3-473f-b889-4961413e29ce {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:23:08.978489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:08.981034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-07497c13-ea49-4bf1-a13b-16c73589c975 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments/dc8cfebb-1742-4123-a364-85809769f25a" status: 202 len: 0 microversion: 2.20 time: 0.336777 Apr 20 19:23:08.981910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 389/768] 10.222.0.48 () {60 vars in 1447 bytes} [Tue Apr 20 19:23:08 2021] DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce/os-volume_attachments/dc8cfebb-1742-4123-a364-85809769f25a => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:23:08.987717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e6f66d69-49d8-45aa-874b-1c495e98b898 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1674 microversion: 2.1 time: 0.236996 Apr 20 19:23:08.988425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 380/769] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:08 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:23:10.007438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:10.008857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:10.017610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.018191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.019021 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.019906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.196759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:10.197309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:10.207523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.208318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.209784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.210305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.275670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:23:10.395871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-284aa5cf-bec9-4272-8f9d-ea130da90f7c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 204 len: 0 microversion: 2.20 time: 0.202853 Apr 20 19:23:10.396910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 381/770] 10.222.0.48 () {60 vars in 1270 bytes} [Tue Apr 20 19:23:10 2021] DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 20 19:23:10.406076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:10.406838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:10.414890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.415377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.416171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:10.416655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:10.702322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:10.712844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bb2844b9-20d8-40f1-a469-952f25273672 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1674 microversion: 2.1 time: 0.709881 Apr 20 19:23:10.714285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 390/771] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:10 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1674 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:11.203145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:11.213679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:11.215930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:11.217327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a2ec8a75-f416-47fd-bf1c-5659dd29edd7 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.815700 Apr 20 19:23:11.220169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 382/772] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:10 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:23:11.732256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:11.732915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:11.742664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:11.742664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:11.742984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:11.743444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:11.934875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:11.944604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f2fd1c8b-5920-4a02-8d4d-0a98de067b76 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1606 microversion: 2.1 time: 0.216490 Apr 20 19:23:11.945546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 391/773] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:11 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1606 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:12.237035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:12.238820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:12.252751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:12.253265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:12.254150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:12.254682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:12.717948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:12.730641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:12.732643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:12.734105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e4cbefcf-8bb0-4ace-95eb-f240e72cb4f1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1722 microversion: 2.20 time: 0.501165 Apr 20 19:23:12.734891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 383/774] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:12 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:12.772455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-19aa2aeb-f39e-4dbd-b11e-c5bb9ae59875 req-1d2503fd-0554-43fb-987a-1c26c19831d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ef72c-8b70-4646-b698-a199605e7183", "name": "network-vif-deleted", "tag": "fd534917-0276-4ed8-88b8-906951ef7306"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:12.774755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:12.774755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:12.802128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-19aa2aeb-f39e-4dbd-b11e-c5bb9ae59875 req-1d2503fd-0554-43fb-987a-1c26c19831d6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:12.802647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-19aa2aeb-f39e-4dbd-b11e-c5bb9ae59875 req-1d2503fd-0554-43fb-987a-1c26c19831d6 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:12.840167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-19aa2aeb-f39e-4dbd-b11e-c5bb9ae59875 req-1d2503fd-0554-43fb-987a-1c26c19831d6 service nova] Creating event network-vif-deleted:fd534917-0276-4ed8-88b8-906951ef7306 for instance 072ef72c-8b70-4646-b698-a199605e7183 on hv-cinder-78693 Apr 20 19:23:12.845694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-19aa2aeb-f39e-4dbd-b11e-c5bb9ae59875 req-1d2503fd-0554-43fb-987a-1c26c19831d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583726 Apr 20 19:23:12.849344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 392/775] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:12.963550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:12.964657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:12.977405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:12.978736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:12.981461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:12.985181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:13.161791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:13.162474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:13.163105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lazy-loading 'fault' on Instance uuid 072ef72c-8b70-4646-b698-a199605e7183 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:23:13.358063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:13.368337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b1bdbbb8-b696-43bf-a5db-ec898d8f56c9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 200 len: 1327 microversion: 2.1 time: 0.409204 Apr 20 19:23:13.369198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 384/776] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:12 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 1327 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:13.755126 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:13.756139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:13.775098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:13.775947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:13.793272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:13.796459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:14.040642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:14.086633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:14.088476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:14.089791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-70140e4e-88b1-463b-8c2a-e13a2d9de006 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 200 len: 1655 microversion: 2.20 time: 0.339878 Apr 20 19:23:14.094704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 393/777] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:13 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 1655 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:14.328529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-f8cadec7-5633-449f-8568-72cc59d46dcc req-61fde167-29e6-4ca9-9e18-e89a683fef2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4274f79-46b3-473f-b889-4961413e29ce", "name": "network-vif-deleted", "tag": "2e0540be-bff7-4e64-b9b7-d68ed1293fdc"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:14.330949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:14.330949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:14.343786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f8cadec7-5633-449f-8568-72cc59d46dcc req-61fde167-29e6-4ca9-9e18-e89a683fef2f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:14.344286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f8cadec7-5633-449f-8568-72cc59d46dcc req-61fde167-29e6-4ca9-9e18-e89a683fef2f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:14.364548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-f8cadec7-5633-449f-8568-72cc59d46dcc req-61fde167-29e6-4ca9-9e18-e89a683fef2f service nova] Creating event network-vif-deleted:2e0540be-bff7-4e64-b9b7-d68ed1293fdc for instance b4274f79-46b3-473f-b889-4961413e29ce on hv-cinder-78693 Apr 20 19:23:14.370843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-f8cadec7-5633-449f-8568-72cc59d46dcc req-61fde167-29e6-4ca9-9e18-e89a683fef2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266956 Apr 20 19:23:14.371508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 385/778] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:14.387191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:14.388424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:14.398530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:14.399529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:14.400618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:14.401285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:14.464688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. Apr 20 19:23:14.465733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:23:14.466708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31994962-9889-48a9-8fa2-dcbacf245e0d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 404 len: 111 microversion: 2.1 time: 0.083845 Apr 20 19:23:14.467515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 394/779] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:14 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:23:14.478351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-40d84e50-4e0a-45a2-8660-097409e784ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '.version_select at 0x7fd8e03ff048>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:14.552281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-40d84e50-4e0a-45a2-8660-097409e784ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645576227" status: 202 len: 0 microversion: 2.1 time: 0.078922 Apr 20 19:23:14.552981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 386/780] 10.222.0.48 () {58 vars in 1208 bytes} [Tue Apr 20 19:23:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645576227 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:15.109603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:15.110598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:15.126078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:15.131829 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:15.132885 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:15.134001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:15.202841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. Apr 20 19:23:15.203967 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:23:15.205086 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e660e6fb-ef8b-4c97-a76a-79480427341f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 404 len: 111 microversion: 2.20 time: 0.100272 Apr 20 19:23:15.206127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 395/781] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:15 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:23:15.214964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-875c789c-c076-47dd-a553-14523bb4d45d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '.version_select at 0x7fd8e0d2f8c8>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:15.241186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-875c789c-c076-47dd-a553-14523bb4d45d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685292182" status: 204 len: 0 microversion: 2.20 time: 0.027904 Apr 20 19:23:15.241881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 387/782] 10.222.0.48 () {60 vars in 1249 bytes} [Tue Apr 20 19:23:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685292182 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:23:15.287053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1862147791", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:15.425804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] validate_networks() for None {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:23:15.795378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:23:15.795847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:23:15.796393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:23:15.796848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:23:15.797305 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:23:15.806807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:15.807315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:15.808178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:15.808648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:15.828577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Getting quotas for project 9691212b367043188156650c42e1a959. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:15.833311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Getting quotas for user e7ca02e561194676b8f19e4a045281f7 and project 9691212b367043188156650c42e1a959. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:15.846298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:23:15.848664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:23:15.897932 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-63b58934-ab4b-4a40-a425-35467a4cd0d7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615161 Apr 20 19:23:15.898942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 396/783] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:23:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:23:15.909578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-17824801-3116-42e1-88b4-22ce3d52d7ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:15.910517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-17824801-3116-42e1-88b4-22ce3d52d7ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:16.014604 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-17824801-3116-42e1-88b4-22ce3d52d7ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:16.024725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-17824801-3116-42e1-88b4-22ce3d52d7ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1215 microversion: 2.1 time: 0.119200 Apr 20 19:23:16.025539 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 388/784] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:15 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:16.741376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: .version_select at 0x7fd8e038a2f0>, body: {"keypair": {"name": "tempest-keypair-1290451479"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:16.770724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:16.775666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:16.946360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:16.950771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:16.965142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f9164755-abbd-42b9-80b4-96e50d6f4c44 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.227890 Apr 20 19:23:16.965824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 397/785] 10.222.0.48 () {60 vars in 1148 bytes} [Tue Apr 20 19:23:16 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:17.044911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:17.045576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:17.055266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:17.056017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:17.057239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:17.058139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:17.192830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:17.213399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-80ff8633-47fd-42d2-b28a-1965abd27f7d tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1267 microversion: 2.1 time: 0.161709 Apr 20 19:23:17.214335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 389/786] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:17 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:18.232304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:18.233576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:18.241745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:18.242300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:18.243143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:18.243631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:18.340704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: .version_select at 0x7fd8e03ffb70>, body: {"keypair": {"name": "tempest-keypair-1730349103"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:18.367957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:18.372728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:18.488708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:18.503304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e23ad36d-346c-40db-ae55-3856740b7579 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1273 microversion: 2.1 time: 0.274623 Apr 20 19:23:18.505894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 398/787] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:18 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:18.684056 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:18.688719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'key_pairs'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:18.704236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-be0a0af3-af10-4f2f-bf4d-7ec5991a9611 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.368294 Apr 20 19:23:18.704901 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 390/788] 10.222.0.48 () {62 vars in 1189 bytes} [Tue Apr 20 19:23:18 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 370 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:23:19.523163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:19.524453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:19.533090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:19.533662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:19.534712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:19.535327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:20.030964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-5a42aa92-ed4a-4e81-8939-f38def68036e req-cb2d4430-1932-4e7d-ba4a-f6f3d5944c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad17b4c4-ccc2-4657-9db7-be0a78a14867", "tag": "4ce21c78-98f3-4503-9672-a10a345f3cc7"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:20.032660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:20.032660 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:20.045296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5a42aa92-ed4a-4e81-8939-f38def68036e req-cb2d4430-1932-4e7d-ba4a-f6f3d5944c21 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:20.046104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5a42aa92-ed4a-4e81-8939-f38def68036e req-cb2d4430-1932-4e7d-ba4a-f6f3d5944c21 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:20.089709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-5a42aa92-ed4a-4e81-8939-f38def68036e req-cb2d4430-1932-4e7d-ba4a-f6f3d5944c21 service nova] Creating event network-changed:4ce21c78-98f3-4503-9672-a10a345f3cc7 for instance ad17b4c4-ccc2-4657-9db7-be0a78a14867 on hv-cinder-78693 Apr 20 19:23:20.096970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-5a42aa92-ed4a-4e81-8939-f38def68036e req-cb2d4430-1932-4e7d-ba4a-f6f3d5944c21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070030 Apr 20 19:23:20.098053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 391/789] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:20.269824 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1374755648", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f331ac5d-ad3b-4e48-8bf1-fb572b65b568"}], "security_groups": [{"name": "tempest-securitygroup--757285664"}], "key_name": "tempest-keypair-1290451479", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:20.598018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:20.609050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d3e12c5a-00fb-4db3-9457-f9a161153243 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1315 microversion: 2.1 time: 1.089818 Apr 20 19:23:20.609698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 399/790] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:19 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:20.822836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] validate_networks() for [('f331ac5d-ad3b-4e48-8bf1-fb572b65b568', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:23:21.628503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:21.629119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:21.637629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:21.638187 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:21.639014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:21.639502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:21.737106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:23:21.738293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:23:21.739091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:23:21.739773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:23:21.740538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:23:21.753165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:21.754403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:21.756203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:21.757338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:21.782998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for project f544a358435545bc91293d5552058381. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:21.789580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Getting quotas for user 1eeca8eb13044a4388b718ffe24134b2 and project f544a358435545bc91293d5552058381. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:21.808637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:23:21.812050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:23:21.884656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cdc10c4d-9c07-40cc-965c-ff5859e23aa7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.619824 Apr 20 19:23:21.885732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 392/791] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:23:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:23:21.902566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-be9b7f6d-9233-4fff-932e-c3c44aeadb7d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:21.903271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-be9b7f6d-9233-4fff-932e-c3c44aeadb7d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:21.914227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:21.925549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9722cf8a-e458-49df-8f83-43ad46e37e36 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1315 microversion: 2.1 time: 0.301272 Apr 20 19:23:21.927073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 400/792] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:21 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:22.027462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-be9b7f6d-9233-4fff-932e-c3c44aeadb7d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:22.039204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-be9b7f6d-9233-4fff-932e-c3c44aeadb7d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1238 microversion: 2.1 time: 0.145984 Apr 20 19:23:22.039875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 393/793] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:21 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:22.945557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:22.946473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:22.954995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:22.955746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:22.956873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:22.957364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:23.063433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:23.064242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:23.074712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:23.082535 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:23.084788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:23.085415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:23.303090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:23.317285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0fde1586-0b2f-4b9f-9869-df628dee63ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1298 microversion: 2.1 time: 0.257653 Apr 20 19:23:23.319537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 394/794] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:23 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:23.327839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:23.337894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ea6c4099-9269-47ff-976b-55aedb990911 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1315 microversion: 2.1 time: 0.396538 Apr 20 19:23:23.338790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 401/795] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:22 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:23.348036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1623091567", "imageRef": "865ebd7c-faa6-41fe-b847-d171c34f4fa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b51c7665-608e-4722-a739-79996e632bcb"}], "security_groups": [{"name": "tempest-securitygroup--655103670"}], "key_name": "tempest-keypair-1730349103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:23.481338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] validate_networks() for [('b51c7665-608e-4722-a739-79996e632bcb', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:23:24.077236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:23:24.077712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:23:24.078538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:23:24.079006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:23:24.079473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:23:24.088688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.089199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.090106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.090605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.109814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:23:24.114043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Getting quotas for user d7dbb77e667d4d58bce2af812656449e and project a6a88356db7b4f36b1d8f8856756e1e3. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:23:24.125697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:23:24.128261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='865ebd7c-faa6-41fe-b847-d171c34f4fa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:23:24.179520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bb291a1b-ce3f-49ef-8cdd-206d59586088 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.842394 Apr 20 19:23:24.180411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 395/796] 10.222.0.48 () {62 vars in 1178 bytes} [Tue Apr 20 19:23:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 19:23:24.191577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:24.192341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:24.276336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:24.287552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:24.289572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:24.291250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-28a32385-76b3-41e6-9a16-cb6de0b628ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1282 microversion: 2.20 time: 0.103731 Apr 20 19:23:24.292003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 402/797] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:24 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:23:24.337820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:24.338435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:24.351016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.351921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.353818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.355433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.357458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:24.358326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:24.374969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.375483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.376489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.376971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:24.736830 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:24.748408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6273983c-c874-4cca-8810-7e21cf998df7 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1315 microversion: 2.1 time: 0.395666 Apr 20 19:23:24.749643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 403/798] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:24 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:23:24.791677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:24.801665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-068ae657-3306-4490-bdac-008c2dfcd49b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.468235 Apr 20 19:23:24.812318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 396/799] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:24 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:24.977371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-f8bdee10-69d4-4273-bfab-a8994f0d201d req-28d5530c-1926-41a0-87b1-4691cadfb52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad17b4c4-ccc2-4657-9db7-be0a78a14867", "name": "network-vif-plugged", "status": "completed", "tag": "4ce21c78-98f3-4503-9672-a10a345f3cc7"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:24.979361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:24.979361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:24.988409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f8bdee10-69d4-4273-bfab-a8994f0d201d req-28d5530c-1926-41a0-87b1-4691cadfb52a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:24.988911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f8bdee10-69d4-4273-bfab-a8994f0d201d req-28d5530c-1926-41a0-87b1-4691cadfb52a service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.006876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-f8bdee10-69d4-4273-bfab-a8994f0d201d req-28d5530c-1926-41a0-87b1-4691cadfb52a service nova] Creating event network-vif-plugged:4ce21c78-98f3-4503-9672-a10a345f3cc7 for instance ad17b4c4-ccc2-4657-9db7-be0a78a14867 on hv-cinder-78693 Apr 20 19:23:25.012558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-f8bdee10-69d4-4273-bfab-a8994f0d201d req-28d5530c-1926-41a0-87b1-4691cadfb52a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190815 Apr 20 19:23:25.013388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 404/800] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:25.312826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:25.313683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:25.341685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.344013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.345292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.346630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.473494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-06cb9758-4ff4-4409-be08-0c6ea0e74ec2 req-0927b26d-8052-456f-95a2-9297c1ef12e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffd316a-28a5-4054-b691-b4c973b309fb", "tag": "2f7307a4-9a7b-4194-bd96-96af63458add"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:25.476200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:25.476200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:25.492118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-06cb9758-4ff4-4409-be08-0c6ea0e74ec2 req-0927b26d-8052-456f-95a2-9297c1ef12e9 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.492864 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-06cb9758-4ff4-4409-be08-0c6ea0e74ec2 req-0927b26d-8052-456f-95a2-9297c1ef12e9 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.539441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-06cb9758-4ff4-4409-be08-0c6ea0e74ec2 req-0927b26d-8052-456f-95a2-9297c1ef12e9 service nova] Creating event network-changed:2f7307a4-9a7b-4194-bd96-96af63458add for instance 8ffd316a-28a5-4054-b691-b4c973b309fb on hv-cinder-78693 Apr 20 19:23:25.546042 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-06cb9758-4ff4-4409-be08-0c6ea0e74ec2 req-0927b26d-8052-456f-95a2-9297c1ef12e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078607 Apr 20 19:23:25.546978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 405/801] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:25.566758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:25.582489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:25.584161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:25.585359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3aea4508-b95e-472a-8d15-350072e92714 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1342 microversion: 2.20 time: 0.277449 Apr 20 19:23:25.596670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 397/802] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:25 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1342 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:25.770881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:25.771715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:25.780016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.780515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.781352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.781869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.820109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:25.820763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:25.829336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.830002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:25.831135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:25.831737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:26.526876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:26.536036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-05f449a5-6b70-4d8d-970f-72fbb27355b3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1315 microversion: 2.1 time: 0.772818 Apr 20 19:23:26.536978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 406/803] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:25 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:26.540137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:26.549918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cce14eb4-42dd-4f38-81f8-72c2bedd98ae tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.734001 Apr 20 19:23:26.550780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 398/804] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:25 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:26.605084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:26.605888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:26.614484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:26.615106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:26.615977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:26.616742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:26.816378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:26.826508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:26.828201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:26.829482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6a38be9d-c9a7-4678-8049-1a1514481f1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1340 microversion: 2.20 time: 0.228571 Apr 20 19:23:26.831007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 407/805] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:26 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:27.558293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:27.559758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:27.568540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:27.568742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:27.569104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:27.569244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:27.569943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:27.570594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:27.577264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:27.578019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:27.579027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:27.579668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.175644 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.178989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.184971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7e276f8e-6bf0-4599-a6c5-323e3ce398ed tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1465 microversion: 2.1 time: 0.633751 Apr 20 19:23:28.185589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 399/806] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:27 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1465 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:28.189283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-42a9143f-d6d1-4aec-829e-08da56f1ea02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.624986 Apr 20 19:23:28.190271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 408/807] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:27 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:28.199726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:28.199726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:28.199726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.200112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.200952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.201442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.260931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:28.261470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:28.269266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.270113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.270916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.271404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.338627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:23:28.461623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-69126c42-ef61-422b-9acc-a4bc5f748bd5 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 204 len: 0 microversion: 2.1 time: 0.203758 Apr 20 19:23:28.462889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 409/808] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:23:28 2021] DELETE /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:23:28.473257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:28.474249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:28.482697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.483336 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.484312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.484915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.721089 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.731977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.734612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.735812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b8718ccd-1049-46d1-9de1-71a7677de724 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1407 microversion: 2.20 time: 0.549003 Apr 20 19:23:28.736466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 400/809] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:28 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:28.742323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-b3b0175d-1fbe-4fa7-aaa0-87f9c7a805b3 req-c8ba506e-bc97-4182-9a1d-5130660fb6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:28.751488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:28.751488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:28.760855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b3b0175d-1fbe-4fa7-aaa0-87f9c7a805b3 req-c8ba506e-bc97-4182-9a1d-5130660fb6df service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:28.761361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-b3b0175d-1fbe-4fa7-aaa0-87f9c7a805b3 req-c8ba506e-bc97-4182-9a1d-5130660fb6df service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:28.778974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-b3b0175d-1fbe-4fa7-aaa0-87f9c7a805b3 req-c8ba506e-bc97-4182-9a1d-5130660fb6df service nova] Creating event network-changed:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:23:28.784040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-b3b0175d-1fbe-4fa7-aaa0-87f9c7a805b3 req-c8ba506e-bc97-4182-9a1d-5130660fb6df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045960 Apr 20 19:23:28.784979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 401/810] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:28.903108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:28.912706 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-14444fd8-c04a-403d-9f18-f56cbeb5be15 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1471 microversion: 2.1 time: 0.444717 Apr 20 19:23:28.913464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 410/811] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:28 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1471 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:29.208968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:29.209781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:29.218262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.219381 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:29.220230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.220749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:29.512638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:29.521986 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a40fc164-8336-44c1-9b17-1e0e330a621f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.317874 Apr 20 19:23:29.522620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 402/812] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:29 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:29.755406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:29.756129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:29.764709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.765053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:29.765884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.766406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:29.931881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:29.932630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:29.940812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.941372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:29.942214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:29.942671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:30.189116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:30.199294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:30.200971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:30.202185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-430590a0-86a4-48e2-a8a3-f72106f8c4a9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1407 microversion: 2.20 time: 0.451019 Apr 20 19:23:30.203032 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 411/813] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:29 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:30.541082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:30.541293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:30.550159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:30.550823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:30.551701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:30.552204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:30.682343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:30.697544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c808f09f-83d1-4f48-abbe-0cea30556871 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1471 microversion: 2.1 time: 0.769759 Apr 20 19:23:30.698510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 403/814] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:29 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:30.836655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:30.846697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d2b58c76-3e2b-4269-8dbb-132ab95b8012 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.310498 Apr 20 19:23:30.847509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 412/815] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:30 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:31.050258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-2ea2beca-9fe1-42ed-8102-d7f743fbc10c req-34a8df06-8c27-4bd7-a35b-7a9853224ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad17b4c4-ccc2-4657-9db7-be0a78a14867", "name": "network-vif-deleted", "tag": "4ce21c78-98f3-4503-9672-a10a345f3cc7"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:31.052001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:31.052001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:31.062309 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2ea2beca-9fe1-42ed-8102-d7f743fbc10c req-34a8df06-8c27-4bd7-a35b-7a9853224ddf service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.064700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-24fc1d23-08c4-4334-982b-b1535e14b956 req-e29762b3-1c34-4e07-8351-1a1ec232e3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffd316a-28a5-4054-b691-b4c973b309fb", "name": "network-vif-plugged", "status": "completed", "tag": "2f7307a4-9a7b-4194-bd96-96af63458add"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:31.065401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-2ea2beca-9fe1-42ed-8102-d7f743fbc10c req-34a8df06-8c27-4bd7-a35b-7a9853224ddf service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.066647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:31.066647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:31.087310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-2ea2beca-9fe1-42ed-8102-d7f743fbc10c req-34a8df06-8c27-4bd7-a35b-7a9853224ddf service nova] Creating event network-vif-deleted:4ce21c78-98f3-4503-9672-a10a345f3cc7 for instance ad17b4c4-ccc2-4657-9db7-be0a78a14867 on hv-cinder-78693 Apr 20 19:23:31.093549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-2ea2beca-9fe1-42ed-8102-d7f743fbc10c req-34a8df06-8c27-4bd7-a35b-7a9853224ddf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047354 Apr 20 19:23:31.096892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-24fc1d23-08c4-4334-982b-b1535e14b956 req-e29762b3-1c34-4e07-8351-1a1ec232e3fa service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.097172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 404/816] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:31.097683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-24fc1d23-08c4-4334-982b-b1535e14b956 req-e29762b3-1c34-4e07-8351-1a1ec232e3fa service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.137387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-24fc1d23-08c4-4334-982b-b1535e14b956 req-e29762b3-1c34-4e07-8351-1a1ec232e3fa service nova] Creating event network-vif-plugged:2f7307a4-9a7b-4194-bd96-96af63458add for instance 8ffd316a-28a5-4054-b691-b4c973b309fb on hv-cinder-78693 Apr 20 19:23:31.148635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-24fc1d23-08c4-4334-982b-b1535e14b956 req-e29762b3-1c34-4e07-8351-1a1ec232e3fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087975 Apr 20 19:23:31.149558 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 413/817] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:23:31.222491 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:31.223631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:31.232462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.233090 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.234025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.234592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.460898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:31.471429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:31.473105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:31.474466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2cb052f2-a367-460f-a05a-cc8f86e627fc tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1407 microversion: 2.20 time: 0.257006 Apr 20 19:23:31.482174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 405/818] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:31 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:31.719749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:31.721816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:31.730503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.731013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.731893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.732384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.805493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.806017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.806513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lazy-loading 'fault' on Instance uuid ad17b4c4-ccc2-4657-9db7-be0a78a14867 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:23:31.864883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:31.865550 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:31.874072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.874561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.874688 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ca02e561194676b8f19e4a045281f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9691212b367043188156650c42e1a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:31.875405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:31.875886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:31.883073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0e362af1-7e61-43e6-977f-36da8640dad3 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 200 len: 1305 microversion: 2.1 time: 0.169944 Apr 20 19:23:31.883701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 414/819] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:31 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:32.101635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:32.111071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-70c1c3fe-41cc-43ca-b797-eca73d2511f8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1363 microversion: 2.1 time: 0.250234 Apr 20 19:23:32.111701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 406/820] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:31 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:23:32.493446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:32.494137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:32.502766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:32.503287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:32.504128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:32.504611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:32.732977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:32.742943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:32.744680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:32.745800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c7af8166-d8e9-4f7d-8858-dc5ae18dd699 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1407 microversion: 2.20 time: 0.256678 Apr 20 19:23:32.746449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 415/821] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:32 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:32.902282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:32.902960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] [instance: ad17b4c4-ccc2-4657-9db7-be0a78a14867] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:32.911328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:32.911834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:32.912663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:32.913150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:32.968776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] HTTP exception thrown: Instance ad17b4c4-ccc2-4657-9db7-be0a78a14867 could not be found. Apr 20 19:23:32.969433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] Returning 404 to user: Instance ad17b4c4-ccc2-4657-9db7-be0a78a14867 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:23:32.970536 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e966f23-2ffc-48c0-b0d4-2732ef7f7a77 tempest-VolumesNegativeTest-1458630704 tempest-VolumesNegativeTest-1458630704-project] 10.222.0.48 "GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867" status: 404 len: 111 microversion: 2.1 time: 0.072479 Apr 20 19:23:32.971135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 407/822] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:32 2021] GET /compute/v2.1/servers/ad17b4c4-ccc2-4657-9db7-be0a78a14867 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:23:33.129295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:33.130014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:33.138252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.138757 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.139589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.140082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.183900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-ac82fe9d-36ac-4845-8bf8-74fb24735820 req-5d6521ee-b0d9-4622-94b4-94cd9209da80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "name": "network-vif-plugged", "status": "completed", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:33.185739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:33.185739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:33.194888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ac82fe9d-36ac-4845-8bf8-74fb24735820 req-5d6521ee-b0d9-4622-94b4-94cd9209da80 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.195356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ac82fe9d-36ac-4845-8bf8-74fb24735820 req-5d6521ee-b0d9-4622-94b4-94cd9209da80 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.213779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-ac82fe9d-36ac-4845-8bf8-74fb24735820 req-5d6521ee-b0d9-4622-94b4-94cd9209da80 service nova] Creating event network-vif-plugged:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:23:33.219002 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-ac82fe9d-36ac-4845-8bf8-74fb24735820 req-5d6521ee-b0d9-4622-94b4-94cd9209da80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040104 Apr 20 19:23:33.219930 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 408/823] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:33.357371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:33.368663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8f8a56a9-04a4-489f-bb58-800794bf1147 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1549 microversion: 2.1 time: 0.243428 Apr 20 19:23:33.369276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 416/824] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:33 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:33.387210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:33.388195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:33.398809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.402133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.403037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.403583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.569784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-624dc58a-9a51-400e-828d-522c989c87a5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187022 Apr 20 19:23:33.570663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 409/825] 10.222.0.48 () {58 vars in 1265 bytes} [Tue Apr 20 19:23:33 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:33.765331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:33.766638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:33.775732 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.776462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:33.777296 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:33.777988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:34.005047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:34.015204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:34.017010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:34.018822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b5078c90-2b2b-4a1a-8c36-92e6d5c0cddb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1407 microversion: 2.20 time: 0.257800 Apr 20 19:23:34.020016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 417/826] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:33 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:35.038733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:35.039386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:35.047919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.048449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.049285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.049772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.278033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:35.288206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:35.290047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:35.291404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d17c45e2-da0c-48ae-a93a-654ffa628a2b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1599 microversion: 2.20 time: 0.256761 Apr 20 19:23:35.292136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 410/827] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:23:35 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1599 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:35.310256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:35.310960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:35.319971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.320964 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.321959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.322562 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.417183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:35.418265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:35.427331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.427841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.428667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.430624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.514653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4648f469-522f-40de-813b-a2d770388e4a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.208552 Apr 20 19:23:35.515516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 418/828] 10.222.0.48 () {60 vars in 1306 bytes} [Tue Apr 20 19:23:35 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:23:35.527513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-afb5aea1-ee69-44db-99ab-9ebe159becfb req-46a113b8-b0bc-4ada-ad81-bea35d2527e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ffd316a-28a5-4054-b691-b4c973b309fb", "tag": "2f7307a4-9a7b-4194-bd96-96af63458add"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:35.530142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:35.530142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:35.541692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-afb5aea1-ee69-44db-99ab-9ebe159becfb req-46a113b8-b0bc-4ada-ad81-bea35d2527e7 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:35.542753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-afb5aea1-ee69-44db-99ab-9ebe159becfb req-46a113b8-b0bc-4ada-ad81-bea35d2527e7 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:35.543321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-15484f3e-e53b-4b74-8421-b6622d78d09a tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.129341 Apr 20 19:23:35.544109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 411/829] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:35 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:35.567920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-afb5aea1-ee69-44db-99ab-9ebe159becfb req-46a113b8-b0bc-4ada-ad81-bea35d2527e7 service nova] Creating event network-changed:2f7307a4-9a7b-4194-bd96-96af63458add for instance 8ffd316a-28a5-4054-b691-b4c973b309fb on hv-cinder-78693 Apr 20 19:23:35.573924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-afb5aea1-ee69-44db-99ab-9ebe159becfb req-46a113b8-b0bc-4ada-ad81-bea35d2527e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051045 Apr 20 19:23:35.575288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 419/830] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:36.556167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:36.558330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:36.567836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:36.568606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:36.569635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:36.570329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:36.677778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5f23f4b4-2bfd-46d4-b4ba-01b084da609f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.125961 Apr 20 19:23:36.678902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 412/831] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:36 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:37.690273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:37.691418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:37.699793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:37.700276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:37.701127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:37.701620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:37.806045 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21c8c6e9-f964-4276-8307-9b58e9c9296e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.120326 Apr 20 19:23:37.807146 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 420/832] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:37 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:38.279726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:38.281176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:38.282277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-4088b2bf-e063-44b8-b24f-032d844b20b3 req-11b689fe-e79e-4dc7-b3e1-0f5a20931be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:38.284386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:38.284386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:38.291046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:38.292070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:38.293266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:38.293970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:38.295052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4088b2bf-e063-44b8-b24f-032d844b20b3 req-11b689fe-e79e-4dc7-b3e1-0f5a20931be1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:38.295690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-4088b2bf-e063-44b8-b24f-032d844b20b3 req-11b689fe-e79e-4dc7-b3e1-0f5a20931be1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:38.318349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-4088b2bf-e063-44b8-b24f-032d844b20b3 req-11b689fe-e79e-4dc7-b3e1-0f5a20931be1 service nova] Creating event network-changed:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:23:38.324182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-4088b2bf-e063-44b8-b24f-032d844b20b3 req-11b689fe-e79e-4dc7-b3e1-0f5a20931be1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046146 Apr 20 19:23:38.325522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 421/833] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:38.394433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-95c35561-dd7f-4793-b53c-a6290ddd1593 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 0.118600 Apr 20 19:23:38.395541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 413/834] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:38 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:38.819460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:38.821344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:38.830818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:38.831719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:38.832797 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:38.833525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:38.944209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2146c64e-5719-45b5-b933-61e783e94f9f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.130614 Apr 20 19:23:38.945191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 422/835] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:38 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:39.407766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:39.409277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:39.419199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:39.419717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:39.420572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:39.421078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:39.523349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cce14a34-754b-4023-bb09-cfd29059a7c4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 0.120125 Apr 20 19:23:39.524060 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 414/836] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:39 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:39.957362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:39.958551 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:39.967533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:39.968039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:39.969103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:39.969360 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:40.071467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-492e8f20-f6e4-4cc9-8531-27f1873b4ef8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.118723 Apr 20 19:23:40.072161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 423/837] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:39 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:40.541304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:40.543199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:40.553484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:40.554048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:40.554887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:40.555376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:40.658476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2dc0094c-6121-411e-8385-6e896f5d24c8 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 0.124939 Apr 20 19:23:40.659151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 415/838] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:40 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:41.084421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:41.085569 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:41.094673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:41.095158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:41.096215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:41.096694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:41.194375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-918b7337-1d65-42ee-9e82-eb4a8d46534f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.114335 Apr 20 19:23:41.195046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 424/839] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:41 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:41.675334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:41.676708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:41.688013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:41.688518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:41.689353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:41.689883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:42.213105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:42.214958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:42.229119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:42.230005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:42.231387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:42.232202 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:44.316565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a5e4de52-1d31-4dc8-99f4-9d9d9fd6b4bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 2.647228 Apr 20 19:23:44.317647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 416/840] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:41 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:44.327951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-90cdaae3-3ccf-4392-adbd-acc4dfcd1556 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 2.122190 Apr 20 19:23:44.328694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 425/841] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:42 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:45.336575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:45.338459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:45.344510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:45.346459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:45.352862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.353662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.355189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.355966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.359925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.360431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.361270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.361760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.462673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c04c330-eedb-4f28-8ad0-cadb795730c1 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 0.133708 Apr 20 19:23:45.463400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 417/842] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:45 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:45.466134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-89abd494-8d66-48e1-a8ab-2a6c3b4349ea tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 14 microversion: 2.1 time: 0.129305 Apr 20 19:23:45.466945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 426/843] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:45 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:45.750298 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-794385002"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:45.750987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:45.759880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.760397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.761237 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:45.761730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:45.977055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.network.security_group_api [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Removing security group b1371fb9-f4d2-40a3-b24a-148e95b9c216 from port 79ce51e3-8bf1-4b3e-acb6-946d6604e11f Apr 20 19:23:46.475704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:46.476886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:46.515855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0148db90-d971-4874-a652-36da198a2ec2 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.771585 Apr 20 19:23:46.517753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:46.518537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:46.520308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 418/844] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:45 2021] POST /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:46.522995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:46.523971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:46.525933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:46.527486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:46.547163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:46.547918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:46.548947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:46.552229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:46.676704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e2b4a251-0f4b-49a8-ae40-f5486070de61 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 14 microversion: 2.20 time: 0.204947 Apr 20 19:23:46.680759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 427/845] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:46 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:46.687918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-7c580353-8180-4a68-b0bc-691d06e5aeaf req-c45519e7-5598-4b06-974f-6b5313ce3034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:46.689673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:46.689673 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:46.693728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1fe7babd-582a-464f-b14c-87c453db3af5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 10009 microversion: 2.1 time: 0.171818 Apr 20 19:23:46.694684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 419/846] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:46 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 10009 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:46.702514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7c580353-8180-4a68-b0bc-691d06e5aeaf req-c45519e7-5598-4b06-974f-6b5313ce3034 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:46.702697 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7c580353-8180-4a68-b0bc-691d06e5aeaf req-c45519e7-5598-4b06-974f-6b5313ce3034 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:46.721586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-7c580353-8180-4a68-b0bc-691d06e5aeaf req-c45519e7-5598-4b06-974f-6b5313ce3034 service nova] Creating event network-changed:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:23:46.726753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-7c580353-8180-4a68-b0bc-691d06e5aeaf req-c45519e7-5598-4b06-974f-6b5313ce3034 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044141 Apr 20 19:23:46.727417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 428/847] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:47.689638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:47.691050 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:47.700707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:47.700707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:47.701923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:47.702653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:47.707639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:47.709234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:47.718965 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:47.719758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:47.720795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:47.721469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:47.814325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8f63b18d-5d81-4138-8575-3589ed72d020 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 10893 microversion: 2.20 time: 0.129043 Apr 20 19:23:47.815088 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 420/848] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:47 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 10893 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:47.824714 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e341e214-9fbd-4043-9ad0-3d3d360179ca tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 16280 microversion: 2.1 time: 0.121627 Apr 20 19:23:47.825573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 429/849] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:47 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 16280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:48.540026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:48.540675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:48.549515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.550020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.551251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.551913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.757611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-ca8f843b-f7b2-4709-b752-a809f107d9e6 req-a9e3577d-d782-42fd-8c98-bb6a034dc471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:48.760687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lazy-loading 'services' on Instance uuid 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:23:48.760949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:48.760949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:48.772300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ca8f843b-f7b2-4709-b752-a809f107d9e6 req-a9e3577d-d782-42fd-8c98-bb6a034dc471 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.773447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ca8f843b-f7b2-4709-b752-a809f107d9e6 req-a9e3577d-d782-42fd-8c98-bb6a034dc471 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.793379 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-ca8f843b-f7b2-4709-b752-a809f107d9e6 req-a9e3577d-d782-42fd-8c98-bb6a034dc471 service nova] Creating event network-changed:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:23:48.799402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-ca8f843b-f7b2-4709-b752-a809f107d9e6 req-a9e3577d-d782-42fd-8c98-bb6a034dc471 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046558 Apr 20 19:23:48.800506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 430/850] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:23:48.826941 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:48.828263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:48.837396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.837908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.838846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.839334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.950103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1ad4ac55-448c-4e5f-b496-ecbc49d01bc0 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 17602 microversion: 2.20 time: 0.127874 Apr 20 19:23:48.950817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 431/851] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:48 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 17602 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:23:48.955530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5691186-3544-4fa4-a336-c20ecfc4286e tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments/b9de2661-f021-44df-a9f2-fd9fbda67b80" status: 202 len: 0 microversion: 2.1 time: 0.419688 Apr 20 19:23:48.956662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 421/852] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:23:48 2021] DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments/b9de2661-f021-44df-a9f2-fd9fbda67b80 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:48.966019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:48.967430 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:48.973087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:48.976128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:48.978810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.979401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.980897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.981596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.994594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:48.995710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:48.996586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:49.003225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:49.072068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8f02a52f-9fdd-4baa-8863-285bce264d89 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110666 Apr 20 19:23:49.072703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 422/853] 10.222.0.48 () {58 vars in 1292 bytes} [Tue Apr 20 19:23:48 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:49.148879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8a8c0f52-99fb-43c7-bfba-48ad5584c65f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 18561 microversion: 2.1 time: 0.195968 Apr 20 19:23:49.149765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 432/854] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:48 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 18561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:49.963073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:49.964297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:49.976184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:49.977018 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:49.979498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:49.980768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.085620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:50.086778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:50.095726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c88b77fb-30ef-4eb1-a1cd-457b7d9d22fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 18449 microversion: 2.20 time: 0.136849 Apr 20 19:23:50.096599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 423/855] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:49 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 18449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:50.101748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.102274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.103121 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.103607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.163073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:50.164282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:50.173871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.174176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.175070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.175637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.189873 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-407607ae-2b0e-4f3c-8f11-8358d56fbad1 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108771 Apr 20 19:23:50.190495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 433/856] 10.222.0.48 () {58 vars in 1292 bytes} [Tue Apr 20 19:23:50 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:23:50.201672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:50.202408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:50.211832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.212437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.213425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:50.213937 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:50.285052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-30c42756-7571-4d7d-bbe6-bf4d1402ed98 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 20991 microversion: 2.1 time: 0.126642 Apr 20 19:23:50.286698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 424/857] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:50 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 20991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:23:50.392210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] HTTP exception thrown: Instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 is not attached to volume b9de2661-f021-44df-a9f2-fd9fbda67b80 Apr 20 19:23:50.392882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Returning 404 to user: Instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 is not attached to volume b9de2661-f021-44df-a9f2-fd9fbda67b80 {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:23:50.393779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4a566c8c-9813-4928-8ac7-40ce4bb14f1d tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments/b9de2661-f021-44df-a9f2-fd9fbda67b80" status: 404 len: 154 microversion: 2.1 time: 0.196805 Apr 20 19:23:50.394418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 434/858] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:23:50 2021] DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0/os-volume_attachments/b9de2661-f021-44df-a9f2-fd9fbda67b80 => generated 154 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:23:51.108155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:51.109233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:51.118378 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.119269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.120114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.120609 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.219741 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-882048ed-8c60-4d18-9849-9a0acdd288fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 20997 microversion: 2.20 time: 0.116112 Apr 20 19:23:51.220417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 425/859] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:51 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 20997 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:51.302337 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:51.304229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:51.319372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.320206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.321579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.322433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.424664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6eddde84-383f-45e7-8462-8ca5d0b3bd59 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 22804 microversion: 2.1 time: 0.128674 Apr 20 19:23:51.425735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 435/860] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:51 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 22804 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:51.663396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:51.664048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:51.672945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.673456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.674329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.674884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.739730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:23:51.858114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ed74a2e6-8e74-4188-8941-475ee07d6d19 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 204 len: 0 microversion: 2.1 time: 0.198971 Apr 20 19:23:51.858834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 426/861] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:23:51 2021] DELETE /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:23:51.868530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:51.869668 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:51.878519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.879024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:51.879855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:51.880352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:52.233672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:52.234895 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:52.243959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:52.244468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:52.245331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:52.245847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:52.348705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a158c115-bcc8-4650-8e5b-0e8872b4b394 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 22987 microversion: 2.20 time: 0.119699 Apr 20 19:23:52.349424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 427/862] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:52 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 22987 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:52.361480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:52.371260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-55d3baeb-1b9f-4359-9841-497a68cdd1da tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1554 microversion: 2.1 time: 0.507443 Apr 20 19:23:52.371923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 436/863] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:51 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1554 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:52.442606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:52.444494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:52.458785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:52.459676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:52.461070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:52.461925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:52.566828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fac3fe76-6bc6-435a-a02c-13475cccb6ab tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 23798 microversion: 2.1 time: 0.130893 Apr 20 19:23:52.567862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 428/864] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:52 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 23798 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:53.365686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:53.367293 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:53.381622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.382511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.383874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.384690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.392663 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:53.393442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:53.402345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.402834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.403678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.404221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.494087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c2edfea-53af-408f-afad-6c0c72aa8ef4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 24325 microversion: 2.20 time: 0.135151 Apr 20 19:23:53.494994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 437/865] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:53 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 24325 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:53.582306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:53.583568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:53.592611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.593113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.593983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:53.594473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:53.626737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:53.636013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e0e89a54-0c64-42ce-847c-9cde13ae98f8 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1554 microversion: 2.1 time: 0.248492 Apr 20 19:23:53.636672 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 429/866] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:53 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:53.701221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d9b6ef43-aa1b-4d6d-b29d-417ea3f2e3e5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 24986 microversion: 2.1 time: 0.123053 Apr 20 19:23:53.702341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 438/867] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:53 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 24986 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:23:54.506225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:54.507594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:54.516709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.517186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.518095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.518583 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.621553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4e5c8cc7-1421-4b5d-aa92-a08ff2a2973e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 25809 microversion: 2.20 time: 0.119279 Apr 20 19:23:54.622350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 430/868] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:54 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 25809 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:54.644290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-7898227d-0e01-42b9-b12d-62cb7a580fa1 req-6a341513-1ecd-476c-b2bc-ba482dd0b7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642e1c0e-359d-4778-ab56-ff9ddec8d5f0", "name": "network-vif-deleted", "tag": "79ce51e3-8bf1-4b3e-acb6-946d6604e11f"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:54.645999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:23:54.645999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:23:54.655724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:54.656223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7898227d-0e01-42b9-b12d-62cb7a580fa1 req-6a341513-1ecd-476c-b2bc-ba482dd0b7ac service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.656533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:54.656679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-7898227d-0e01-42b9-b12d-62cb7a580fa1 req-6a341513-1ecd-476c-b2bc-ba482dd0b7ac service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.665446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.666005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.666888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.667390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.675462 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-7898227d-0e01-42b9-b12d-62cb7a580fa1 req-6a341513-1ecd-476c-b2bc-ba482dd0b7ac service nova] Creating event network-vif-deleted:79ce51e3-8bf1-4b3e-acb6-946d6604e11f for instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 on hv-cinder-78693 Apr 20 19:23:54.680879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-7898227d-0e01-42b9-b12d-62cb7a580fa1 req-6a341513-1ecd-476c-b2bc-ba482dd0b7ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041015 Apr 20 19:23:54.681486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 439/869] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:54.717072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:54.718349 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:54.727075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.727674 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.728584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:54.729125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:54.796397 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b113a4487e4921a36c55cce6a014c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c1c47f974a4031bc62166d5cf50696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:23:54.805738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e5619481-1157-4ec0-9856-e29af461aa24 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 200 len: 1342 microversion: 2.1 time: 0.154969 Apr 20 19:23:54.806433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 431/870] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:54 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:23:54.841385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6987d858-2bf2-4622-89c4-c82bbc86dbb2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 26565 microversion: 2.1 time: 0.128767 Apr 20 19:23:54.842080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 440/871] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:54 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 26565 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:23:55.638831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:55.640099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:55.650012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.650614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.651593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.652167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.757396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-08720b82-9eef-4981-b33b-03208bfa2b7b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 27054 microversion: 2.20 time: 0.124683 Apr 20 19:23:55.758332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 432/872] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:55 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 27054 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:55.829566 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:55.830914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] [instance: 642e1c0e-359d-4778-ab56-ff9ddec8d5f0] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:55.845594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.846490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.847843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.848763 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.859057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:55.860208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:55.869470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.870053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.870881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:55.871371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:55.907198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] HTTP exception thrown: Instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 could not be found. Apr 20 19:23:55.907870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Returning 404 to user: Instance 642e1c0e-359d-4778-ab56-ff9ddec8d5f0 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:23:55.908766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a777b95d-2e0e-40de-965d-9ac40bd3d5d6 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0" status: 404 len: 111 microversion: 2.1 time: 0.087186 Apr 20 19:23:55.909373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 441/873] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:23:55 2021] GET /compute/v2.1/servers/642e1c0e-359d-4778-ab56-ff9ddec8d5f0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:23:55.917957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-66955d78-2371-46ac-8d8e-47119cc87c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] Calling method '.version_select at 0x7fd8e00392f0>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:55.935802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-66955d78-2371-46ac-8d8e-47119cc87c53 tempest-TestMinimumBasicScenario-1528215880 tempest-TestMinimumBasicScenario-1528215880-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-888872452" status: 202 len: 0 microversion: 2.1 time: 0.021291 Apr 20 19:23:55.936145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 442/874] 10.222.0.48 () {58 vars in 1259 bytes} [Tue Apr 20 19:23:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-888872452 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:23:55.970099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6c1f66fb-2b93-47e2-b1dc-49d31c93d9f5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 27343 microversion: 2.1 time: 0.116990 Apr 20 19:23:55.970786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 433/875] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:55 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 27343 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:56.770675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:56.771809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:56.781679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:56.782295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:56.783213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:56.783711 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:56.884113 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e6811645-4d75-435a-9a47-a7496124ff8c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 27647 microversion: 2.20 time: 0.117397 Apr 20 19:23:56.884840 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 443/876] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:56 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 27647 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:56.984356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:56.985612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:56.994847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:56.995350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:56.996212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:56.996703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:57.103170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-15686551-c0ae-4643-b058-a034bcd25b2f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 27808 microversion: 2.1 time: 0.123608 Apr 20 19:23:57.104439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 434/877] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:56 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 27808 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:57.897825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:57.898922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:57.907981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:57.908487 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:57.909327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:57.909816 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:58.020548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-53e99525-3652-4eb0-b2b9-b979ade7aaae tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28113 microversion: 2.20 time: 0.127213 Apr 20 19:23:58.021243 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 444/878] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:57 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28113 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:58.117940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:58.119111 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:58.128495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:58.129225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:58.130116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:58.130618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:58.235596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d5cd5182-291e-4a54-a041-c757f4b70507 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28172 microversion: 2.1 time: 0.122272 Apr 20 19:23:58.236569 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 435/879] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:58 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28172 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:23:59.034433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:59.035633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:59.044740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:59.045230 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:59.046132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:59.046670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:59.155597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e0bd2025-7a8f-42c5-bf5f-5b744b4becda tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28175 microversion: 2.20 time: 0.125774 Apr 20 19:23:59.156304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 445/880] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:23:59 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28175 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:23:59.250459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:23:59.251599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:23:59.260333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:59.260836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:59.261669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:23:59.262219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:23:59.361372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2d2e4b9d-e63c-49d9-a9cd-866936e1ca32 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28317 microversion: 2.1 time: 0.115508 Apr 20 19:23:59.361984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 436/881] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:23:59 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:00.169607 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:00.170721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:00.179981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:00.180684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:00.181662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:00.182458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:00.286980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f1987881-47e6-493b-b865-41fb7f21b706 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28466 microversion: 2.20 time: 0.121603 Apr 20 19:24:00.287801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 446/882] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:00 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:00.374445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:00.375729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:00.385044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:00.385567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:00.386524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:00.387096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:00.495853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-64dad322-4c18-47c3-98c0-c4314ca97c53 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28588 microversion: 2.1 time: 0.125721 Apr 20 19:24:00.496627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 437/883] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:00 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28588 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:01.302715 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:01.304263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:01.313365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:01.313878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:01.314836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:01.315306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:01.416191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4bd7af59-7bea-43eb-8abf-406f22163945 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28634 microversion: 2.20 time: 0.118207 Apr 20 19:24:01.416936 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 447/884] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:01 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28634 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:01.510762 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:01.512192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:01.522440 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:01.523109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:01.524545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:01.525449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:01.632109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d9741852-89ae-4c30-a5ff-8d5ae6472117 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28631 microversion: 2.1 time: 0.126206 Apr 20 19:24:01.633101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 438/885] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:01 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28631 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:02.430370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:02.431704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:02.441265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:02.441730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:02.442612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:02.443107 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:02.562862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dc9d570d-403d-4bcb-a4ed-ef66f7e4ccc5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28634 microversion: 2.20 time: 0.137222 Apr 20 19:24:02.563567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 448/886] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:02 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28634 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:02.645913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:02.646943 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:02.655993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:02.656516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:02.657351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:02.657868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:02.762222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1ef9ef8a-4c18-4719-9fcc-843648ced2c7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28631 microversion: 2.1 time: 0.120791 Apr 20 19:24:02.762924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 439/887] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:02 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28631 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:03.576666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:03.578015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:03.587154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:03.587661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:03.588502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:03.588993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:03.688414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f5ddab61-ce15-429e-bcd4-0ddd24ef0013 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 28634 microversion: 2.20 time: 0.116286 Apr 20 19:24:03.689421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 449/888] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:03 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 28634 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:03.776070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:03.777888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:03.786981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:03.787502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:03.788341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:03.788843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:03.886951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-73a0f87e-5482-4ad1-bb53-f69f9bf579e9 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 28631 microversion: 2.1 time: 0.115452 Apr 20 19:24:03.887572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 440/889] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:03 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 28631 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:04.702206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:04.703527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:04.712588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:04.713134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:04.713987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:04.714626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:04.816817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-16700171-4858-4112-b7ee-1a8cc2dfa5fe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 29630 microversion: 2.20 time: 0.119226 Apr 20 19:24:04.817445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 450/890] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:04 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 29630 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:24:04.900017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:04.901201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:04.910646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:04.911156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:04.911987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:04.912481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:05.018169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-44ce81ab-c920-46b8-a5bf-e14f223e5903 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 29783 microversion: 2.1 time: 0.122523 Apr 20 19:24:05.019134 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 441/891] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:04 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 29783 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:05.830656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:05.831783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:05.841273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:05.841790 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:05.842645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:05.843153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:05.946633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ad71bb63-0d71-485a-a3b4-8f85959edd82 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 31575 microversion: 2.20 time: 0.120522 Apr 20 19:24:05.947751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 451/892] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:05 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 31575 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:06.031869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:06.033297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:06.042905 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:06.043753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:06.044755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:06.045417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:06.153382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6b76138f-2f88-4f5d-a4bf-b0f7dd8b1e7b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 31675 microversion: 2.1 time: 0.125863 Apr 20 19:24:06.154329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 442/893] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:06 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 31675 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:06.960228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:06.961377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:06.970347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:06.970858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:06.971710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:06.972198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:07.080277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5ea57932-b30d-41c1-830d-b9732e2d722f tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 33007 microversion: 2.20 time: 0.124466 Apr 20 19:24:07.080954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 452/894] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:06 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 33007 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:07.167636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:07.168782 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:07.177703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:07.178241 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:07.179081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:07.179570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:07.283313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-82596d3d-78b8-4258-9ccc-7ead1ad865b4 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 32952 microversion: 2.1 time: 0.120227 Apr 20 19:24:07.284327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 443/895] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:07 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 32952 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:08.094770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:08.097890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:08.108836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:08.109460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:08.110417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:08.110985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:08.218934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f38a5eab-1cef-40d8-91b3-1473c0315efd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 33902 microversion: 2.20 time: 0.129139 Apr 20 19:24:08.219622 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 453/896] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:08 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 33902 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:08.297891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:08.299081 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:08.307910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:08.308429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:08.309263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:08.309752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:08.414910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0ffed3c9-07ce-40cb-8067-8609c3d2e27b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 33912 microversion: 2.1 time: 0.121357 Apr 20 19:24:08.419996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 444/897] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:08 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 33912 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:09.232557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:09.233707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:09.243019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:09.243527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:09.244366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:09.244938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:09.346929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-358d4ec4-4ecc-4341-9e04-7ed595acd909 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 35282 microversion: 2.20 time: 0.118772 Apr 20 19:24:09.348690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 454/898] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:09 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 35282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:09.428691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:09.429879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:09.438740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:09.439259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:09.440122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:09.440624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:09.539784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-43334219-6ebe-4750-a5e7-d5cf2d8a122f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 35367 microversion: 2.1 time: 0.115495 Apr 20 19:24:09.540494 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 445/899] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:09 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 35367 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:10.362142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:10.363694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:10.374620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:10.375098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:10.375954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:10.376446 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:10.476478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-79230920-68ef-4c18-a8a0-6737907f0327 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 36748 microversion: 2.20 time: 0.119897 Apr 20 19:24:10.477180 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 455/900] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:10 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 36748 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:10.553877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:10.555161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:10.564603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:10.565123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:10.566078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:10.566574 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:10.673565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-88f3b6f4-a0f4-4b35-9335-b7078435190c tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 36789 microversion: 2.1 time: 0.123750 Apr 20 19:24:10.674686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 446/901] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:10 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 36789 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:11.495602 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:11.497463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:11.511159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:11.511671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:11.512504 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:11.513014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:11.614743 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fb34627e-f41f-441c-972b-985e41bbaa64 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 38137 microversion: 2.20 time: 0.127095 Apr 20 19:24:11.615956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 456/902] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:11 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 38137 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:11.694794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:11.696682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:11.711384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:11.712247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:11.713533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:11.714063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:11.818772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31f6516a-7a14-485d-b1a2-08a4e4b2c223 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 38153 microversion: 2.1 time: 0.131388 Apr 20 19:24:11.819474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 447/903] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:11 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 38153 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:12.630257 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:12.631408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:12.640341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:12.640851 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:12.641698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:12.642214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:12.741229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1b678cab-91a4-430d-8750-140b2621e7fb tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 38192 microversion: 2.20 time: 0.115546 Apr 20 19:24:12.741889 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 457/904] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:12 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 38192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:12.837205 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:12.839159 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:12.853420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:12.854016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:12.854850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:12.855342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:12.955725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6253f5f9-5ba4-411f-82c9-7f063fc13dc7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 38158 microversion: 2.1 time: 0.125912 Apr 20 19:24:12.956694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 448/905] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:12 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 38158 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:13.759931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:13.761072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:13.770030 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:13.770534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:13.771371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:13.771904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:13.870140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-40fcf2b6-9f44-45e5-8d1d-2b134b28330a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 38192 microversion: 2.20 time: 0.117385 Apr 20 19:24:13.871222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 458/906] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:13 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 38192 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:13.975544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:13.977407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:13.992217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:13.993074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:13.994384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:13.994887 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:14.091139 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7ed56913-8a70-46b1-a810-c6da63040ed5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 38158 microversion: 2.1 time: 0.123111 Apr 20 19:24:14.091754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 449/907] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:13 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 38158 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:14.888922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:14.890844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:14.903333 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:14.903838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:14.904679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:14.905165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:15.005098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ed5cfdca-41ba-42f6-9c23-e5bc2913d56c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 38192 microversion: 2.20 time: 0.123227 Apr 20 19:24:15.005870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 459/908] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:14 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 38192 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:15.105503 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:15.106614 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:15.115708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:15.116214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:15.117052 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:15.117542 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:15.220079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e91ca160-23a4-47de-a81b-97f7febff959 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 38158 microversion: 2.1 time: 0.118899 Apr 20 19:24:15.221067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 450/909] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:15 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 38158 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:16.025641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:16.027534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:16.042177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.042686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.043529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.044026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.145434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a2303970-e1de-4c2f-a512-6ca36c39cd02 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 200 len: 38335 microversion: 2.20 time: 0.127632 Apr 20 19:24:16.146236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 460/910] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:16 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 38335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:16.158768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:16.159449 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:16.168153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.168651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.169484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.170014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.231181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f910d0c9-a218-42fd-99ac-0670a945f82b tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/ips" status: 200 len: 151 microversion: 2.20 time: 0.077037 Apr 20 19:24:16.231796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 451/911] 10.222.0.48 () {60 vars in 1279 bytes} [Tue Apr 20 19:24:16 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:16.234046 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:16.235190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:16.244400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.245063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.245817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.246327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.342639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-adf890c3-5c6e-47d3-b7ab-00c5b8a0162d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action" status: 200 len: 38289 microversion: 2.1 time: 0.113053 Apr 20 19:24:16.343335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 461/912] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:16 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/action => generated 38289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:16.354209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:16.354756 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:16.362814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.363324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.364157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:16.365012 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:16.426724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8e4ded88-a726-4593-8674-097cceb0efd8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/ips" status: 200 len: 146 microversion: 2.1 time: 0.076629 Apr 20 19:24:16.427405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 452/913] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:24:16 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:17.955658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c247cd9e-a568-4730-8d61-789a903d76e8"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:17.957036 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:17.966343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:17.966846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:17.967676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:17.968162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:18.353292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9896467d-e899-4faa-87d5-916a2807623f tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402191 Apr 20 19:24:18.354118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 462/914] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:24:17 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:18.437485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:18.439316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:18.448195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:18.448677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:18.449725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:18.450271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:18.510978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lazy-loading 'flavor' on Instance uuid 3ab01f73-3ab3-4e1a-915e-8e32c1627836 {{(pid=100515) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:24:18.885406 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-084ec767-3868-44f5-a48e-6c5f116eb0f9 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 202 len: 0 microversion: 2.20 time: 0.452914 Apr 20 19:24:18.886161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 453/915] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:18 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:24:18.895789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:18.896559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:18.906038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:18.906547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:18.907400 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:18.907878 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:19.130882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:19.141882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:19.143563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:19.144788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-43db8624-292a-4bf9-a31e-6ebf5f5845ab tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.253656 Apr 20 19:24:19.145389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 463/916] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:18 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:20.170591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:20.171856 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:20.185015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:20.185527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:20.186402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:20.186896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:20.404210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:20.413791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:20.416147 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:20.418413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9df2f261-6a07-457e-b49c-cb095b35cef2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.255059 Apr 20 19:24:20.419007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 454/917] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:20 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:21.443639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:21.444744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:21.458899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:21.459692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:21.461063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:21.461913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:21.835950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:21.845523 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:21.847225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:21.848578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-663e9b26-beef-44e1-bbe1-104ac3583598 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.411996 Apr 20 19:24:21.849194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 464/918] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:21 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:22.870413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:22.871240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:22.881982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:22.882641 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:22.883869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:22.884515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:23.100612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:23.110171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:23.111834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:23.113423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-680d5cfd-3861-4221-830c-45cfcd5f6c7d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.248070 Apr 20 19:24:23.114067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 455/919] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:22 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:24.132953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:24.133623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:24.142145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:24.142647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:24.143473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:24.143960 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:24.370314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:24.380133 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:24.381767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:24.383023 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-41d020a5-7b65-456f-b894-4b58671b12a6 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.254313 Apr 20 19:24:24.383633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 465/920] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:24 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:25.245678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:25.246845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:25.254888 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.255396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.256226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.256712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.324560 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bd54a218-3d6e-4548-8834-47bf76353028 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084390 Apr 20 19:24:25.325100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 456/921] 10.222.0.48 () {58 vars in 1292 bytes} [Tue Apr 20 19:24:25 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:25.339355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:25.339907 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:25.348274 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.348799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.349654 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.350176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.403059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:25.403657 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:25.411573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.412067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.412893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:25.413384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:25.420166 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6e24f7d2-2ec6-4317-a84a-c8d281c523cb tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8" status: 200 len: 194 microversion: 2.1 time: 0.085101 Apr 20 19:24:25.420779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 466/922] 10.222.0.48 () {58 vars in 1403 bytes} [Tue Apr 20 19:24:25 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:25.626861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:25.636758 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:25.638549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:25.639863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6084a9be-5e2f-4125-b1ec-7fe9b176e1b2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.241080 Apr 20 19:24:25.640565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 457/923] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:25 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:26.664041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:26.665130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:26.678450 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:26.679260 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:26.680718 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:26.681529 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:26.902279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:26.911999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:26.913680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:26.915015 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8de6c7f5-0973-487e-ab52-c922f7e09d30 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.258015 Apr 20 19:24:26.915585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 467/924] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:26 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:26.938514 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8205c2f7-14b2-4216-aabb-eb432f0e6bcf"}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:26.939725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:26.948278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:26.948781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:26.949623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:26.950181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:27.338828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ee871fd7-14d4-448f-b81b-0d8cbe678308 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404449 Apr 20 19:24:27.339497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 458/925] 10.222.0.48 () {60 vars in 1313 bytes} [Tue Apr 20 19:24:26 2021] POST /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:27.939419 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:27.940515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:27.951692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:27.952194 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:27.953058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:27.953540 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:28.181326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:28.191316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:28.192934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:28.194192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-342d6187-f267-46a8-bf55-0fbaf06e153e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.262028 Apr 20 19:24:28.194818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 468/926] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:27 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:29.219169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:29.220173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:29.373252 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:29.373662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:29.374533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:29.375024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:29.590181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:29.605507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:29.608157 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:29.610047 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dffa1cc7-e2f9-4901-a5c5-e90d54cb81a3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1744 microversion: 2.20 time: 0.397851 Apr 20 19:24:29.610916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 459/927] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:29 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1744 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:30.635350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:30.636453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:30.650175 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:30.650748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:30.651600 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:30.652079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:30.873949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:30.883771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:30.885519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:30.886731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ba6ac47a-6d89-4cdf-a408-0d8113ada784 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1744 microversion: 2.20 time: 0.258635 Apr 20 19:24:30.887373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 469/928] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:30 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:31.907355 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:31.908719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:31.917746 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:31.918273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:31.919335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:31.919814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:32.153372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:32.163171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:32.165411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:32.166946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-506cb84e-bdee-438e-9c3d-3e2daa181f1d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.264800 Apr 20 19:24:32.167537 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 460/929] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:31 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:33.195259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:33.198234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-1b098fa4-9c6f-4c03-a240-14be194a3822 req-d5b6d9d5-f285-4de8-bf2b-f1a6c3378a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "name": "network-vif-plugged", "status": "completed", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:33.200783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:33.205564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:24:33.205564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:24:33.221693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:33.224452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-1b098fa4-9c6f-4c03-a240-14be194a3822 req-d5b6d9d5-f285-4de8-bf2b-f1a6c3378a82 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:33.228524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:33.230454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-1b098fa4-9c6f-4c03-a240-14be194a3822 req-d5b6d9d5-f285-4de8-bf2b-f1a6c3378a82 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:33.231128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:33.231778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:33.278191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-1b098fa4-9c6f-4c03-a240-14be194a3822 req-d5b6d9d5-f285-4de8-bf2b-f1a6c3378a82 service nova] Creating event network-vif-plugged:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:24:33.284367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-1b098fa4-9c6f-4c03-a240-14be194a3822 req-d5b6d9d5-f285-4de8-bf2b-f1a6c3378a82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098407 Apr 20 19:24:33.285183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 461/930] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:33.505224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:33.515424 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:33.517101 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:33.518384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d161001-ba46-47b9-b64c-a3272255f0f5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.331013 Apr 20 19:24:33.518987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 470/931] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:33 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:34.542618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:34.544026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:34.553900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:34.554680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:34.555577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:34.556068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:34.797152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:34.808751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:34.810810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:34.812272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1436a23f-586b-469f-80c1-85bcd7810862 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.275199 Apr 20 19:24:34.813097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 462/932] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:34 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:35.240058 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:35.241311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:35.251108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.251719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.252649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.253217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.326806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0cd302c1-af0a-4b80-b43c-f982f6f82a4e tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.091349 Apr 20 19:24:35.327433 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 471/933] 10.222.0.48 () {58 vars in 1292 bytes} [Tue Apr 20 19:24:35 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:35.554990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:35.556311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:35.567478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.567987 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.568867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.569356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.644425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1c40b011-e68d-4011-82a2-87512b96c3f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8" status: 200 len: 194 microversion: 2.1 time: 0.093520 Apr 20 19:24:35.645373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 463/934] 10.222.0.48 () {58 vars in 1403 bytes} [Tue Apr 20 19:24:35 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:35.656067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:35.656621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:35.665322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.665862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.666712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.667208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.832224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:35.833105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:35.843039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.843867 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.844841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:35.845407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:35.864343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lazy-loading 'services' on Instance uuid 8ffd316a-28a5-4054-b691-b4c973b309fb {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:24:36.073924 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-60ba64d9-4b61-4a41-a0e3-8cfb0d9a199b tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8" status: 202 len: 0 microversion: 2.1 time: 0.421741 Apr 20 19:24:36.074880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 472/935] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:24:35 2021] DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/c247cd9e-a568-4730-8d61-789a903d76e8 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:36.171313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:36.184225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:36.186261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:36.187502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-72dd7243-3877-4c6d-86ff-a3975344ca96 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.359420 Apr 20 19:24:36.188184 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 464/936] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:35 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:37.209327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:37.210302 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:37.221587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:37.222145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:37.223008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:37.223502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:37.509071 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:37.521151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:37.522956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:37.524326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f54153e0-7d70-4de0-800c-3a97c5034eec tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.320645 Apr 20 19:24:37.525112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 473/937] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:37 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:38.417276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:38.418029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:38.426307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.426910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.427843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.428521 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.503839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d77fc64-70f2-4df8-8ca5-19f42f090d92 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/8205c2f7-14b2-4216-aabb-eb432f0e6bcf" status: 200 len: 194 microversion: 2.1 time: 0.090724 Apr 20 19:24:38.504664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 465/938] 10.222.0.48 () {58 vars in 1403 bytes} [Tue Apr 20 19:24:38 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/8205c2f7-14b2-4216-aabb-eb432f0e6bcf => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:38.515436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:38.515979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:38.524216 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.524726 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.525568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.526127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.546219 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:38.546883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:38.555387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.555882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.556720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:38.557210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:38.733372 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lazy-loading 'services' on Instance uuid 8ffd316a-28a5-4054-b691-b4c973b309fb {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:24:38.796418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:38.808719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:38.809606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:38.810923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b57bc283-32ea-4bbd-afb8-b38aa5c34b70 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.269453 Apr 20 19:24:38.813698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 466/939] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:38 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:38.905689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21550b5c-db6c-4181-af28-b918c4eb03c8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/8205c2f7-14b2-4216-aabb-eb432f0e6bcf" status: 202 len: 0 microversion: 2.1 time: 0.394362 Apr 20 19:24:38.906386 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 474/940] 10.222.0.48 () {58 vars in 1406 bytes} [Tue Apr 20 19:24:38 2021] DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb/os-volume_attachments/8205c2f7-14b2-4216-aabb-eb432f0e6bcf => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:24:39.831044 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:39.832329 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:39.840870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:39.841577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:39.842642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:39.843141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:40.107493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:40.118453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:40.120292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:40.122137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a9df4ae9-49ec-4ec5-a9c1-c21836d1832a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1739 microversion: 2.20 time: 0.295383 Apr 20 19:24:40.123198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 467/941] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:39 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:40.552524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:40.553173 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:40.561933 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:40.562461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:40.563292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:40.563825 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:40.629137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:24:40.749807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21446640-8216-4315-ac14-e069ef0b82e8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 204 len: 0 microversion: 2.1 time: 0.201545 Apr 20 19:24:40.750474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 475/942] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:24:40 2021] DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:24:40.760801 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:40.761475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:40.769474 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:40.770034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:40.770876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:40.771343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:40.994350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:41.003570 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-27555c4a-3826-4763-bbd1-619087dc3fd5 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1674 microversion: 2.1 time: 0.247672 Apr 20 19:24:41.004208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 468/943] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:40 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1674 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:41.143004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:41.143768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:41.152075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:41.152584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:41.153425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:41.153958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:41.374953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:41.385145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:41.386835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:41.388100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f6a03caf-f5f3-46dd-ad26-731919ccfddd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1721 microversion: 2.20 time: 0.249924 Apr 20 19:24:41.388699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 476/944] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:41 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:42.026999 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:42.028110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:42.040416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:42.040919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:42.041760 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:42.042283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:42.270659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:42.279978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b959da85-40cc-499b-8016-a37ed8c5f6ac tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1674 microversion: 2.1 time: 0.260143 Apr 20 19:24:42.280616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 469/945] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:42 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:42.412831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:42.413931 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:42.427118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:42.427963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:42.429358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:42.429869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:42.649519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:42.659328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:42.660983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:42.662456 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-16a51eb7-e34d-4283-9dd6-c26a431e8dfe tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1721 microversion: 2.20 time: 0.256695 Apr 20 19:24:42.663128 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 477/946] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:42 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:43.128993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-5daf3860-fed9-4c97-8f4c-f2e0d426dd8f req-be039d73-f772-454f-ad15-39a0326aa3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffd316a-28a5-4054-b691-b4c973b309fb", "name": "network-vif-unplugged", "status": "completed", "tag": "2f7307a4-9a7b-4194-bd96-96af63458add"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:43.130913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:24:43.130913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:24:43.139946 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5daf3860-fed9-4c97-8f4c-f2e0d426dd8f req-be039d73-f772-454f-ad15-39a0326aa3a1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.140453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5daf3860-fed9-4c97-8f4c-f2e0d426dd8f req-be039d73-f772-454f-ad15-39a0326aa3a1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.158398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-5daf3860-fed9-4c97-8f4c-f2e0d426dd8f req-be039d73-f772-454f-ad15-39a0326aa3a1 service nova] Creating event network-vif-unplugged:2f7307a4-9a7b-4194-bd96-96af63458add for instance 8ffd316a-28a5-4054-b691-b4c973b309fb on hv-cinder-78693 Apr 20 19:24:43.163956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-5daf3860-fed9-4c97-8f4c-f2e0d426dd8f req-be039d73-f772-454f-ad15-39a0326aa3a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039074 Apr 20 19:24:43.164823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 470/947] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:43.298792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:43.299777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:43.308365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.308874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.309822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.310371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.528267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:43.537451 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-31590566-b89f-48e1-83da-63db6b20bc02 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1674 microversion: 2.1 time: 0.242918 Apr 20 19:24:43.538231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 478/948] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:43 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:43.686679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:43.687994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:43.699353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.699859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.700694 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.701183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.926532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:43.936576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:43.938310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:43.939548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-22e158e1-6891-4226-b0ae-c61e9700b121 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1724 microversion: 2.20 time: 0.260870 Apr 20 19:24:43.940178 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 471/949] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:43 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:43.958879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de66a0a6-597c-4415-8ae2-80b07d8d8538"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:43.960455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:43.968871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.969415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:43.970311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:43.970804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:44.423617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-33f644ec-9b72-4b19-a23c-b938eb17f2fd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.469121 Apr 20 19:24:44.424280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 479/950] 10.222.0.48 () {62 vars in 1354 bytes} [Tue Apr 20 19:24:43 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-volume_attachments => generated 188 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:24:44.540846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:44.541565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:44.549677 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:44.550217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:44.551226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:44.551902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:44.556387 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:44.557155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:44.565546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:44.565993 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:44.566919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:44.567453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:44.695269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:44.705751 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f4a65a38-e2b0-47ec-bef4-a6ef5984ac58 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1607 microversion: 2.1 time: 0.153425 Apr 20 19:24:44.706893 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 480/951] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:44 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1607 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:45.000661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e8fe0fc4-d958-4205-9519-841a2f1751bd tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-volume_attachments/de66a0a6-597c-4415-8ae2-80b07d8d8538" status: 202 len: 0 microversion: 2.20 time: 0.464134 Apr 20 19:24:45.001405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 472/952] 10.222.0.48 () {60 vars in 1447 bytes} [Tue Apr 20 19:24:44 2021] DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/os-volume_attachments/de66a0a6-597c-4415-8ae2-80b07d8d8538 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:24:45.136312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:45.137037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:45.146679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.147599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.148624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.149286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.214865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-014abeeb-f478-46ea-a2a3-06db4f499f3d req-570ce525-9eaf-41df-973b-129fd15630bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ffd316a-28a5-4054-b691-b4c973b309fb", "name": "network-vif-deleted", "tag": "2f7307a4-9a7b-4194-bd96-96af63458add"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:45.217103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:24:45.217103 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:24:45.229330 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-014abeeb-f478-46ea-a2a3-06db4f499f3d req-570ce525-9eaf-41df-973b-129fd15630bc service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.230848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-014abeeb-f478-46ea-a2a3-06db4f499f3d req-570ce525-9eaf-41df-973b-129fd15630bc service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.256624 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-014abeeb-f478-46ea-a2a3-06db4f499f3d req-570ce525-9eaf-41df-973b-129fd15630bc service nova] Creating event network-vif-deleted:2f7307a4-9a7b-4194-bd96-96af63458add for instance 8ffd316a-28a5-4054-b691-b4c973b309fb on hv-cinder-78693 Apr 20 19:24:45.261954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-014abeeb-f478-46ea-a2a3-06db4f499f3d req-570ce525-9eaf-41df-973b-129fd15630bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051107 Apr 20 19:24:45.262666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 473/953] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:24:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:24:45.268571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-d45ad849-aba6-4466-89cb-d81cecda7f72 req-3a59c926-def8-4fbd-be7d-0c6fc3fbbc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "name": "network-vif-unplugged", "status": "completed", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:45.270633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:24:45.270633 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:24:45.293649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d45ad849-aba6-4466-89cb-d81cecda7f72 req-3a59c926-def8-4fbd-be7d-0c6fc3fbbc6b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.294682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d45ad849-aba6-4466-89cb-d81cecda7f72 req-3a59c926-def8-4fbd-be7d-0c6fc3fbbc6b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.314780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.compute.server_external_events [req-d45ad849-aba6-4466-89cb-d81cecda7f72 req-3a59c926-def8-4fbd-be7d-0c6fc3fbbc6b service nova] Unable to find a host for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836. Dropping event network-vif-unplugged {{(pid=100515) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 19:24:45.315747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-d45ad849-aba6-4466-89cb-d81cecda7f72 req-3a59c926-def8-4fbd-be7d-0c6fc3fbbc6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051725 Apr 20 19:24:45.316896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 474/954] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:24:45 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 19:24:45.346248 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-22bf895b-5f88-4598-97de-eea91ef025fa tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action" status: 202 len: 0 microversion: 2.20 time: 0.214718 Apr 20 19:24:45.347108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 481/955] 10.222.0.48 () {62 vars in 1309 bytes} [Tue Apr 20 19:24:45 2021] POST /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:24:45.355779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:45.356576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:45.365478 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.366049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.366886 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.367373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.653490 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:45.664095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:45.665808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:45.667095 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e757af86-af9b-42b8-b6f5-740181415ada tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1672 microversion: 2.20 time: 0.315469 Apr 20 19:24:45.667695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 475/956] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:45 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1672 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:45.727192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:45.727870 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:45.736357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.736956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.737690 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.738208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.834314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:45.838994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:45.839519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lazy-loading 'fault' on Instance uuid 8ffd316a-28a5-4054-b691-b4c973b309fb {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:24:45.941476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eeca8eb13044a4388b718ffe24134b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f544a358435545bc91293d5552058381', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:45.950740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4b53c56c-2cef-4363-a964-d07793c1ea47 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 200 len: 1328 microversion: 2.1 time: 0.230682 Apr 20 19:24:45.951620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 482/957] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:45 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 1328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:46.687817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:46.689450 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:46.699218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:46.700106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:46.701452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:46.702391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:46.970114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:46.970998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:46.981582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:46.982455 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:46.984279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:46.984927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:47.048896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. Apr 20 19:24:47.049949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:24:47.051054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-838df72d-c93a-49ab-bd72-2e94f0b4f6f1 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 404 len: 111 microversion: 2.1 time: 0.085864 Apr 20 19:24:47.051900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 483/958] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:46 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:24:47.060982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d5d807be-785f-4e47-a53a-8c5534c77d9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '.version_select at 0x7fd8e038a0d0>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:47.101703 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d5d807be-785f-4e47-a53a-8c5534c77d9d tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290451479" status: 202 len: 0 microversion: 2.1 time: 0.044829 Apr 20 19:24:47.102680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 484/959] 10.222.0.48 () {58 vars in 1211 bytes} [Tue Apr 20 19:24:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290451479 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:47.171908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:47.183920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:47.185910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:47.187364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e9ce02bc-7d07-4464-9f00-f2deac3bbbad tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1674 microversion: 2.20 time: 0.503919 Apr 20 19:24:47.188186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 476/960] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:46 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1674 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:48.208948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:48.209655 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:48.218167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:48.218684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:48.219652 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:48.220013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:48.468594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:48.480427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:48.482812 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:48.485413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d9ab5d00-3359-48bc-9063-71e49171fdb5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.281013 Apr 20 19:24:48.486232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 485/961] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:48 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:49.505557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:49.506373 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:49.515511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:49.515511 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:49.516093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:49.516561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:49.748176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:49.759909 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:49.761927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:49.763353 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6223f474-4600-4339-97f8-37ff24af3820 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.262136 Apr 20 19:24:49.764123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 477/962] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:49 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:50.250747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:24:50.251776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:50.260775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.261258 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.262415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.262912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.327181 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lazy-loading 'flavor' on Instance uuid 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:24:50.481439 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-21f9d67b-5238-45c4-92f0-dd7da7289d31 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "POST /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8/action" status: 202 len: 0 microversion: 2.1 time: 0.234469 Apr 20 19:24:50.482132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 486/963] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:24:50 2021] POST /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:24:50.491744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:50.492420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:50.500632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.501154 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.502019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.502510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.730842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:50.740747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4fc436db-23d1-4cf8-9169-5da2e27ea140 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.253153 Apr 20 19:24:50.741323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 478/964] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:50 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:50.783894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:50.784850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:50.793922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.794691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.795617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.796183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.840454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:50.841207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:50.850634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.851229 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.852153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.852749 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.907918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. Apr 20 19:24:50.908616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:24:50.909695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6f3d3747-9cde-4a32-b46a-4205d31f80a7 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 404 len: 111 microversion: 2.1 time: 0.073760 Apr 20 19:24:50.910352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 479/965] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:24:50 2021] DELETE /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:24:50.919059 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:50.919739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 8ffd316a-28a5-4054-b691-b4c973b309fb] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:50.928016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.928522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.929376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:50.929915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:50.989350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. Apr 20 19:24:50.990097 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 8ffd316a-28a5-4054-b691-b4c973b309fb could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:24:50.991066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ad9e9304-13d5-4e8f-a07d-7b4bdd048e35 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb" status: 404 len: 111 microversion: 2.1 time: 0.075916 Apr 20 19:24:50.991820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 480/966] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:50 2021] GET /compute/v2.1/servers/8ffd316a-28a5-4054-b691-b4c973b309fb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:24:51.045234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:51.068014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:51.071527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:51.071527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-66ae0110-e739-459f-a8db-a664bacc9d6a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.292457 Apr 20 19:24:51.072322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 487/967] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:50 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:51.760361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:51.761162 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:51.769438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:51.769985 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:51.770833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:51.771324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:51.996860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:52.006369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c024a7a3-ab4e-4137-93b5-b393ccd6471f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.250686 Apr 20 19:24:52.007003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 481/968] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:51 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:52.091821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:52.092351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:52.100695 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.101204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.102085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.102580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.260447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:52.261156 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:52.269476 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.270123 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.271082 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.271649 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.329530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. Apr 20 19:24:52.330327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:24:52.331442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9f555139-bfa2-4a5a-bb53-f05b5949a1a8 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 404 len: 111 microversion: 2.1 time: 0.075058 Apr 20 19:24:52.332190 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 482/969] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:24:52 2021] DELETE /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:24:52.333608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:52.340809 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:52.341525 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] [instance: 072ef72c-8b70-4646-b698-a199605e7183] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:52.349755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:52.350384 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.351008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.351416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:52.351948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:52.352662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-00cbc80f-7cdb-4460-9893-7fcac7130a5a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.265198 Apr 20 19:24:52.352777 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:52.353461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 488/970] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:52 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:52.414817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] HTTP exception thrown: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. Apr 20 19:24:52.415485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] Returning 404 to user: Instance 072ef72c-8b70-4646-b698-a199605e7183 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:24:52.416396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-457a56ae-c995-471e-8965-c65ee3289fd2 tempest-AttachVolumeTestJSON-1509297480 tempest-AttachVolumeTestJSON-1509297480-project] 10.222.0.48 "GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183" status: 404 len: 111 microversion: 2.1 time: 0.079761 Apr 20 19:24:52.417206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 483/971] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:52 2021] GET /compute/v2.1/servers/072ef72c-8b70-4646-b698-a199605e7183 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 19:24:53.025314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:53.025953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:53.034629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:53.035142 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:53.035992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:53.036486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:53.348432 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:53.358702 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-be9c29d7-ade4-446e-a44e-bd02d2aff0a3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.337548 Apr 20 19:24:53.359838 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 489/972] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:53 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:53.374804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:53.375480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:53.384275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:53.384785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:53.385639 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:53.386201 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:53.790454 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:53.801468 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:53.803492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:53.804827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1df2b4aa-4f26-4027-af59-ba0f20eb7875 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.434285 Apr 20 19:24:53.805533 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 484/973] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:53 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:54.379806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:54.380297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:54.389518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:54.390209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:54.391256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:54.391742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:54.763629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:54.780567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f2ac3516-5870-4cc5-a371-7deeb5fc763d tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.406387 Apr 20 19:24:54.782236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 490/974] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:54 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:24:54.825223 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:54.825938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:54.835408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:54.835922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:54.836783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:54.837279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:55.346806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:55.358251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:55.359903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:55.361155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-24a614f6-5edb-4dee-a500-ad6b8afec96e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.540694 Apr 20 19:24:55.361784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 485/975] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:54 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:55.803601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:55.805011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:55.814255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:55.815222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:55.816522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:55.817284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:56.141307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:56.149318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ce54c1c1-f096-4918-ab75-9fa9f37ace90 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.352709 Apr 20 19:24:56.150323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 491/976] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:55 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:56.382231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:56.382914 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:56.391153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:56.391684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:56.392549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:56.393051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:56.638140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:56.649475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:56.653140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:56.653140 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d2bface5-4d38-43b8-a84c-b4de52050fa2 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.274734 Apr 20 19:24:56.664727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 486/977] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:56 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:57.170884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:57.171561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:57.180130 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:57.180635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:57.184770 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:57.185506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:57.542902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:57.559417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c977883c-de4a-4652-af44-0a7607462934 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.394605 Apr 20 19:24:57.560398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 492/978] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:57 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:57.672737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:57.673417 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:57.687099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:57.688458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:57.690098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:57.690991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:57.950884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:57.965354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:57.967383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:57.969865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b9d6dd2e-1b9d-4e32-9828-137bf3a9639a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.300883 Apr 20 19:24:57.971239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 487/979] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:57 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:24:58.586957 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:58.587971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:58.598902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:58.599408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:58.600267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:58.600739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:58.991863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:24:58.991863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:24:58.992845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:59.003621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:59.005748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-360ccb27-9a81-4399-a5c5-61fc072e09cb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.424567 Apr 20 19:24:59.006407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:59.007366 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:24:59.007899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:24:59.008534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 493/980] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:24:58 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:24:59.479733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:59.490908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:59.492725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:24:59.494026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f2d0c817-a19c-420c-a01b-67c741bfd58a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.507923 Apr 20 19:24:59.494990 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 488/981] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:24:58 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:00.027176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:00.027774 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:00.035939 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:00.036538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:00.037369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:00.037868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:00.513897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:00.514615 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:00.523552 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:00.524066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:00.524920 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:00.525422 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:00.738051 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:00.747853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2badc9a6-7019-4fb7-9328-d10e9723fa8f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.724876 Apr 20 19:25:00.748441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 494/982] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:00 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:00.872869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:00.883085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:00.884764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:00.886040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3830f20a-b120-4b18-bb8e-04bdf45b840a tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.376346 Apr 20 19:25:00.886643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 489/983] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:00 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:01.767172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:01.767935 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:01.775970 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:01.776479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:01.777323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:01.777811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:01.904754 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:01.905441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:01.913486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:01.914099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:01.914949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:01.915441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:02.048141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:02.058314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7e62a68f-108d-48a3-a8c5-c67033a27f0b tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.295355 Apr 20 19:25:02.067416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 495/984] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:01 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:02.148069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:02.158481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:02.160117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:02.161342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a118143d-b8bd-4f55-9189-d08fd35afda5 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.260731 Apr 20 19:25:02.162001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 490/985] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:01 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:03.077361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:03.078092 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:03.086198 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:03.086969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:03.087991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:03.088632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:03.181425 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:03.182505 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:03.192584 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:03.193268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:03.194475 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:03.195104 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:03.517882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:03.528593 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cf9318a9-6bce-43f2-ab5d-136bf02cb452 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.455242 Apr 20 19:25:03.529214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 496/986] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:03 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:03.622817 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:03.633072 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:03.634828 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:03.636251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1e308548-81f6-48d7-b6e1-233d16c05eee tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.459441 Apr 20 19:25:03.636658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 491/987] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:03 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:03.648685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-a88be05f-67ea-4f8a-a309-9af41496e647 req-b9e77197-c795-4e03-8b46-03bf77c33e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "name": "network-vif-plugged", "status": "completed", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:03.650806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:25:03.650806 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:25:03.662129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-a88be05f-67ea-4f8a-a309-9af41496e647 req-b9e77197-c795-4e03-8b46-03bf77c33e14 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:03.662613 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-a88be05f-67ea-4f8a-a309-9af41496e647 req-b9e77197-c795-4e03-8b46-03bf77c33e14 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:03.681687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-a88be05f-67ea-4f8a-a309-9af41496e647 req-b9e77197-c795-4e03-8b46-03bf77c33e14 service nova] Creating event network-vif-plugged:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:25:03.688144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-a88be05f-67ea-4f8a-a309-9af41496e647 req-b9e77197-c795-4e03-8b46-03bf77c33e14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043606 Apr 20 19:25:03.689099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 497/988] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:25:04.548776 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:04.549238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:04.561304 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:04.561786 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:04.562708 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:04.563192 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:04.656698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:04.657434 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:04.672962 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:04.673520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:04.674407 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:04.674900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:04.813991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:04.827842 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a697d2e6-08ea-4484-a715-182cd2cb77d8 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.284203 Apr 20 19:25:04.829054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 492/989] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:04 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:04.995290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:05.006232 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:05.008083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:05.010008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cb8ebb4b-9aa7-4568-9eea-0b7ee12f5865 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1730 microversion: 2.20 time: 0.358442 Apr 20 19:25:05.010876 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 498/990] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:04 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:25:05.847717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:05.849153 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:05.858467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:05.859208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:05.860106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:05.860600 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:06.029284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:06.030161 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:06.038647 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:06.039371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:06.040391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:06.041028 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:06.096485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:06.109775 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d41d2e34-99c7-4d72-94e6-062787afb10f tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.266575 Apr 20 19:25:06.114114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 493/991] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:05 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:06.266122 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:06.275963 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:06.277616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:06.278906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1f2b9deb-4bcf-42bc-b125-e64f23e4ba4e tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1717 microversion: 2.20 time: 0.253735 Apr 20 19:25:06.279581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 499/992] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:06 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:07.128627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:07.129409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:07.137531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:07.138117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:07.138975 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:07.139466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:07.362480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:07.371547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a1d54fc5-67e9-4891-ab3b-bde637be5b60 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.247027 Apr 20 19:25:07.372169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 494/993] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:07 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:08.390351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:08.390988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:08.399276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:08.399785 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:08.400636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:08.401125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:09.131435 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:09.140908 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-49279e31-df81-455c-ada8-3ceb4ebfb187 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.754686 Apr 20 19:25:09.151710 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 500/994] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:08 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:10.160215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:10.160808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:10.169183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:10.169698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:10.170579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:10.171080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:10.392416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:10.401549 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-8731a49d-fed9-45ab-98da-eacaa2ec7826 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.245752 Apr 20 19:25:10.402212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 495/995] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:10 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:11.420527 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:11.421427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:11.429645 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:11.430371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:11.431502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:11.432207 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:11.659035 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:11.671498 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-09a7e0d3-66a4-418b-9fe7-eceadf8d7059 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.254885 Apr 20 19:25:11.672396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 501/996] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:11 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:12.691269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:12.691945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:12.699972 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:12.700480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:12.701314 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:12.701807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:12.922016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:12.931247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1342286a-95f6-4487-8baa-5a29ff418110 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1509 microversion: 2.1 time: 0.244095 Apr 20 19:25:12.931874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 496/997] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:12 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:12.949592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:12.950245 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:12.958420 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:12.958923 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:12.959747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:12.960226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:13.113485 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9cc3f29f-1627-427c-9abf-0883c1abcef5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "POST /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8/action" status: 202 len: 0 microversion: 2.1 time: 0.168122 Apr 20 19:25:13.114374 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 502/998] 10.222.0.48 () {60 vars in 1268 bytes} [Tue Apr 20 19:25:12 2021] POST /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:25:13.122918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:13.123597 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:13.131846 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:13.132361 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:13.133189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:13.133871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:13.259445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-0177a945-ad20-4b3d-9385-b75248230452 req-81e7ff9a-10d6-4465-99e1-03289740435f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "name": "network-vif-unplugged", "status": "completed", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:13.262063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:25:13.262063 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:25:13.282938 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0177a945-ad20-4b3d-9385-b75248230452 req-81e7ff9a-10d6-4465-99e1-03289740435f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:13.283457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-0177a945-ad20-4b3d-9385-b75248230452 req-81e7ff9a-10d6-4465-99e1-03289740435f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:13.301545 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.compute.server_external_events [req-0177a945-ad20-4b3d-9385-b75248230452 req-81e7ff9a-10d6-4465-99e1-03289740435f service nova] Unable to find a host for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8. Dropping event network-vif-unplugged {{(pid=100514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 19:25:13.302766 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-0177a945-ad20-4b3d-9385-b75248230452 req-81e7ff9a-10d6-4465-99e1-03289740435f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047905 Apr 20 19:25:13.303605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 503/999] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 20 19:25:13.392135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:13.401383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f0cb2e77-f305-429c-bcc5-125fe0a443c3 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1517 microversion: 2.1 time: 0.282497 Apr 20 19:25:13.402043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 497/1000] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:13 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1517 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:14.420376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:14.422250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:14.431452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:14.432331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:14.433325 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:14.434642 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:14.832832 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:14.843001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7a73b7d9-a647-431c-a0d1-e2d9a121d382 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1519 microversion: 2.1 time: 0.426465 Apr 20 19:25:14.843701 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 504/1001] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:14 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:15.863249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:15.863921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:15.872906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:15.874522 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:15.875507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:15.876191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:16.111991 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:16.122341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0ee1a30c-a563-421c-8010-1a1dce6d4442 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.263441 Apr 20 19:25:16.122982 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 498/1002] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:15 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:17.140736 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:17.141892 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:17.150835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:17.151342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:17.152199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:17.152692 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:17.374271 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:17.384394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-90f41e4b-591d-4f3d-b61e-e94d569bc9d9 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.247904 Apr 20 19:25:17.385144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 505/1003] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:17 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:18.404393 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:18.405171 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:18.413698 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:18.414251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:18.415112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:18.415631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:18.646108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:18.655744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-eb3835a6-bd61-4ab3-b89e-4e48f4eefe0a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.255667 Apr 20 19:25:18.656635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 499/1004] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:18 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:19.675170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:19.675834 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:19.684401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:19.684903 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:19.685780 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:19.686394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:19.909120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:19.918421 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dd891035-5eda-488e-9bc9-f8f4352ada24 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.247226 Apr 20 19:25:19.919005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 506/1005] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:19 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:20.937954 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:20.938730 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:20.947283 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:20.947799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:20.948656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:20.949148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:21.191717 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:21.201405 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bd0b24a7-2c1a-46f2-b5a0-39c5a8090acb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.267603 Apr 20 19:25:21.208208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 500/1006] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:20 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:22.221719 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:22.222345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:22.231295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:22.231807 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:22.232656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:22.233132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:22.465321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:22.475278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-74cbf05b-cef2-4f86-8796-098368d058fb tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.258344 Apr 20 19:25:22.475852 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 507/1007] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:22 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:23.494841 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:23.495554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:23.504195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:23.504716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:23.505589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:23.506127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:23.734202 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:23.745974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-623b6548-9d36-4da7-b371-b679c1c7c7f5 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.255211 Apr 20 19:25:23.746629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 501/1008] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:23 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:24.765686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:24.766764 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:24.776450 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:24.776958 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:24.777822 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:24.778356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:25.008968 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:25.019850 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cc04e1da-1978-44cf-93aa-c91ca74bbe19 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.258574 Apr 20 19:25:25.020492 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 508/1009] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:24 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:25.458188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-5cde9c8c-223b-41f0-990e-cb3f1207c818 req-e2d7a79c-aa97-460e-b815-b9079554ceff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "name": "network-vif-plugged", "status": "completed", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:25.460007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:25:25.460007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:25:25.469500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5cde9c8c-223b-41f0-990e-cb3f1207c818 req-e2d7a79c-aa97-460e-b815-b9079554ceff service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:25.470039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-5cde9c8c-223b-41f0-990e-cb3f1207c818 req-e2d7a79c-aa97-460e-b815-b9079554ceff service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:25.488826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-5cde9c8c-223b-41f0-990e-cb3f1207c818 req-e2d7a79c-aa97-460e-b815-b9079554ceff service nova] Creating event network-vif-plugged:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:25:25.494463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-5cde9c8c-223b-41f0-990e-cb3f1207c818 req-e2d7a79c-aa97-460e-b815-b9079554ceff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040852 Apr 20 19:25:25.495131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 502/1010] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:25:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:25:26.038459 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:26.039087 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:26.047684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:26.048189 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:26.049027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:26.049512 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:26.272959 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:26.286684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-54f9e237-7c5a-4408-b4e1-d10aefc9926a tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1575 microversion: 2.1 time: 0.252064 Apr 20 19:25:26.287577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 509/1011] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:26 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:27.312003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:27.313076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:27.326208 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:27.326820 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:27.328385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:27.329005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:27.561193 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:27.570292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e8ba6a3f-e570-4461-b06c-9dab60e9093c tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1562 microversion: 2.1 time: 0.265575 Apr 20 19:25:27.570858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 503/1012] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:27 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1562 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:25:39.712288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:39.712882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:39.721590 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:39.722143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:39.722984 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:39.723473 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:39.792844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:25:39.911934 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-643f3ac8-32ac-4961-a2a3-1b06a96916d3 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 204 len: 0 microversion: 2.20 time: 0.203452 Apr 20 19:25:39.912568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 510/1013] 10.222.0.48 () {60 vars in 1270 bytes} [Tue Apr 20 19:25:39 2021] DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:25:39.921724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:39.922414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:39.930707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:39.931228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:39.932068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:39.932563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:40.492546 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:40.511096 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:40.512767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:40.514016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c1baa1ce-f33f-4200-8477-3ddf7b19ec57 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.596451 Apr 20 19:25:40.514819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 504/1014] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:39 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:41.535221 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:41.536742 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:41.545810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:41.546317 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:41.547427 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:41.548152 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:42.023515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:42.034005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:42.036108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:42.037563 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c1621bf2-59e3-48a2-b394-b354ce6dd983 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1723 microversion: 2.20 time: 0.506926 Apr 20 19:25:42.038319 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 511/1015] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:41 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:42.988646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-623857cd-f78b-4260-ada4-537e04bc373c req-74eca86e-f89a-4d86-abab-2f63c5f253c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab01f73-3ab3-4e1a-915e-8e32c1627836", "name": "network-vif-deleted", "tag": "bde0918c-62ad-4a79-915f-f6c570fad047"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:42.990413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:25:42.990413 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:25:43.014488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-623857cd-f78b-4260-ada4-537e04bc373c req-74eca86e-f89a-4d86-abab-2f63c5f253c0 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:43.015085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-623857cd-f78b-4260-ada4-537e04bc373c req-74eca86e-f89a-4d86-abab-2f63c5f253c0 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:43.036531 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-623857cd-f78b-4260-ada4-537e04bc373c req-74eca86e-f89a-4d86-abab-2f63c5f253c0 service nova] Creating event network-vif-deleted:bde0918c-62ad-4a79-915f-f6c570fad047 for instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 on hv-cinder-78693 Apr 20 19:25:43.042344 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-623857cd-f78b-4260-ada4-537e04bc373c req-74eca86e-f89a-4d86-abab-2f63c5f253c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058034 Apr 20 19:25:43.046326 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 505/1016] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:25:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:25:43.066767 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:43.067461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:43.091978 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:43.092450 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:43.093303 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:43.093787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:43.192783 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:43.193603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:43.194297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lazy-loading 'fault' on Instance uuid 3ab01f73-3ab3-4e1a-915e-8e32c1627836 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:25:43.292704 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:43.303739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:43.305623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7dbb77e667d4d58bce2af812656449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a88356db7b4f36b1d8f8856756e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:25:43.307074 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4734a242-01c4-4338-8164-738d9e5a21a4 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 200 len: 1372 microversion: 2.20 time: 0.254209 Apr 20 19:25:43.326013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 512/1017] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:43 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:25:44.333877 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:44.334753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:44.343322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:44.343833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:44.344675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:44.345170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:44.401352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. Apr 20 19:25:44.402121 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:25:44.403038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-af3ed947-f2bd-4b6c-9874-5736e43bdf95 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 404 len: 111 microversion: 2.20 time: 0.075001 Apr 20 19:25:44.403659 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 506/1018] 10.222.0.48 () {60 vars in 1267 bytes} [Tue Apr 20 19:25:44 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:25:44.413070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2408a5e4-e54c-4a32-b667-f22646305349 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '.version_select at 0x7fd8e038a9d8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:44.432277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2408a5e4-e54c-4a32-b667-f22646305349 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730349103" status: 204 len: 0 microversion: 2.20 time: 0.023336 Apr 20 19:25:44.432922 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 513/1019] 10.222.0.48 () {60 vars in 1252 bytes} [Tue Apr 20 19:25:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730349103 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:25:46.761409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:46.762024 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:46.770643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:46.771204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:46.772345 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:46.773083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:46.825332 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. Apr 20 19:25:46.826033 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:25:46.826929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c3b3cb4e-8196-4d97-ab34-6c9394aaad48 tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 404 len: 111 microversion: 2.1 time: 0.069788 Apr 20 19:25:46.827575 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 507/1020] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:25:46 2021] DELETE /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:25:46.836510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:46.837170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: 3ab01f73-3ab3-4e1a-915e-8e32c1627836] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:46.845197 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:46.845700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:46.846547 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:46.847039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:46.903236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. Apr 20 19:25:46.903912 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance 3ab01f73-3ab3-4e1a-915e-8e32c1627836 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:25:46.904814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3632fecc-35dc-443e-8f83-3fa14bf554ed tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836" status: 404 len: 111 microversion: 2.1 time: 0.072541 Apr 20 19:25:46.905448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 514/1021] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:46 2021] GET /compute/v2.1/servers/3ab01f73-3ab3-4e1a-915e-8e32c1627836 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:25:48.166837 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:48.167469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:48.176284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:48.176802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:48.177844 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:48.178367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:48.233565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. Apr 20 19:25:48.234388 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:25:48.235368 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2e93d4df-5054-4bad-a6b6-95615824aa9d tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 404 len: 111 microversion: 2.1 time: 0.072984 Apr 20 19:25:48.236070 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 508/1022] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:25:48 2021] DELETE /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:25:48.244995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:48.245665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] [instance: b4274f79-46b3-473f-b889-4961413e29ce] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:25:48.254029 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:48.254530 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:48.255370 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:25:48.255862 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:25:48.316919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] HTTP exception thrown: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. Apr 20 19:25:48.317587 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] Returning 404 to user: Instance b4274f79-46b3-473f-b889-4961413e29ce could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:25:48.318524 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a3e2d1c2-2782-4664-8328-451203ad2c1c tempest-AttachVolumeShelveTestJSON-99680025 tempest-AttachVolumeShelveTestJSON-99680025-project] 10.222.0.48 "GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce" status: 404 len: 111 microversion: 2.1 time: 0.078002 Apr 20 19:25:48.319093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 515/1023] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:25:48 2021] GET /compute/v2.1/servers/b4274f79-46b3-473f-b889-4961413e29ce => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:25:53.532358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:25:53.532899 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:25:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:25:57.499108 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-62ed7ca4-47dc-4496-9bd4-9af3441eef31 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Action: 'create', calling method: .version_select at 0x7fd8e02ecea0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1619446755", "metadata": {"Type": "work"}}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:25:58.190037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-62ed7ca4-47dc-4496-9bd4-9af3441eef31 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.859972 Apr 20 19:25:58.195765 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 509/1024] 10.222.0.48 () {60 vars in 1146 bytes} [Tue Apr 20 19:25:57 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 868 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 19:25:58.214621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1d496cf5-1284-46cc-824b-cb4cd2de5c3b tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e038a510>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:58.361707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1d496cf5-1284-46cc-824b-cb4cd2de5c3b tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 200 len: 353 microversion: 2.1 time: 0.151431 Apr 20 19:25:58.362365 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 516/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:25:58 2021] GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:25:59.376102 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bcf5b7c1-62bf-4b3f-a26d-8754081c8050 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e02de268>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:59.508453 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bcf5b7c1-62bf-4b3f-a26d-8754081c8050 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 200 len: 354 microversion: 2.1 time: 0.136916 Apr 20 19:25:59.511321 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 510/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:25:59 2021] GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:25:59.523151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cf505979-9c0e-442c-9364-93513b6d79df tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e0d378c8>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:59.652211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cf505979-9c0e-442c-9364-93513b6d79df tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 200 len: 354 microversion: 2.1 time: 0.133183 Apr 20 19:25:59.653138 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 517/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:25:59 2021] GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:25:59.686251 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-ec6c6843-9ca1-4b49-aa61-d413326930af tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e02de840>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:59.809648 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-ec6c6843-9ca1-4b49-aa61-d413326930af tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 202 len: 0 microversion: 2.1 time: 0.140778 Apr 20 19:25:59.811014 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 511/1028] 10.222.0.48 () {58 vars in 1238 bytes} [Tue Apr 20 19:25:59 2021] DELETE /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:25:59.823581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a6a5ad3e-e8fc-44f9-9d52-93e626b47df7 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e0265620>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:59.948658 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a6a5ad3e-e8fc-44f9-9d52-93e626b47df7 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 200 len: 353 microversion: 2.1 time: 0.129100 Apr 20 19:25:59.949264 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 518/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:25:59 2021] GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:00.963872 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bdbcb284-ee3f-4da2-b064-03afba72faa4 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Calling method '.version_select at 0x7fd8e02de8c8>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:01.041996 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-bdbcb284-ee3f-4da2-b064-03afba72faa4 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] HTTP exception thrown: Volume e86b0a55-0ed9-4a96-851e-3735a34b606d could not be found. Apr 20 19:26:01.042638 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bdbcb284-ee3f-4da2-b064-03afba72faa4 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] Returning 404 to user: Volume e86b0a55-0ed9-4a96-851e-3735a34b606d could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:26:01.043802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bdbcb284-ee3f-4da2-b064-03afba72faa4 tempest-VolumesGetTestJSON-737726555 tempest-VolumesGetTestJSON-737726555-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d" status: 404 len: 109 microversion: 2.1 time: 0.085889 Apr 20 19:26:01.044415 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 512/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Tue Apr 20 19:26:00 2021] GET /compute/v2.1/os-volumes/e86b0a55-0ed9-4a96-851e-3735a34b606d => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:26:03.110712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Action: 'create', calling method: .version_select at 0x7fd8e0039268>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-63752255"}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:03.135331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:26:03.139599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for user 3ece67f51abc4ee487279f8966d80949 and project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:26:03.251155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:26:03.255308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for user 3ece67f51abc4ee487279f8966d80949 and project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'key_pairs'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:26:03.269409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-506c97b3-1b71-4574-9a29-f5876547b986 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.367175 Apr 20 19:26:03.270267 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 519/1031] 10.222.0.48 () {60 vars in 1148 bytes} [Tue Apr 20 19:26:02 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:22.425947 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1863709163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63752255", "security_groups": [{"name": "tempest-secgroup-smoke-1956524667"}], "block_device_mapping_v2": [{"uuid": "ffcfc12f-09c4-47f4-a451-cde2b1a4e768", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ab03e81-f151-4ff5-bd7e-2e4ac4930244"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:22.599656 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] validate_networks() for [('3ab03e81-f151-4ff5-bd7e-2e4ac4930244', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:26:23.182681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:26:23.183150 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:26:23.183683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:26:23.184135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:26:23.184589 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:26:23.194037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:23.194538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:23.195394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:23.195882 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:23.218601 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:26:23.223288 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for user 3ece67f51abc4ee487279f8966d80949 and project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:26:23.334463 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:26:23.336904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ffcfc12f-09c4-47f4-a451-cde2b1a4e768',volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:26:23.523404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3cf7828a-3e6a-4bd4-a782-8f8577585166 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.102070 Apr 20 19:26:23.524564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 513/1032] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:26:22 2021] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:26:23.535729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-a4acaf17-01eb-43ed-acad-0c234987b753 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:23.537213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-a4acaf17-01eb-43ed-acad-0c234987b753 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:23.632256 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-a4acaf17-01eb-43ed-acad-0c234987b753 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:23.641185 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-a4acaf17-01eb-43ed-acad-0c234987b753 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1093 microversion: 2.1 time: 0.109576 Apr 20 19:26:23.641868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 520/1033] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:23 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1093 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:24.660403 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:24.661847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:24.671682 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:24.672266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:24.673471 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:24.673988 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:24.812279 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:24.821875 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-97093224-6ce4-44f5-aaff-29bb291b5782 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1209 microversion: 2.1 time: 0.165671 Apr 20 19:26:24.822588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 514/1034] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:24 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:25.840927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:25.841564 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:25.850119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:25.850631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:25.851483 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:25.852143 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:26.572795 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:26.582311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fb7c86cd-a245-4aed-9073-a10e9383459d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.745493 Apr 20 19:26:26.582952 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 521/1035] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:25 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:27.065075 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-78dca7f2-21ef-425c-8eba-79981c4034a0 req-0fc31b56-329a-4889-9ee6-8f9cd3c00727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860762bc-50d2-469d-867b-79f2189ebd21", "tag": "d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:27.068358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:27.068358 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:26:27.080003 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-78dca7f2-21ef-425c-8eba-79981c4034a0 req-0fc31b56-329a-4889-9ee6-8f9cd3c00727 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:27.080585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-78dca7f2-21ef-425c-8eba-79981c4034a0 req-0fc31b56-329a-4889-9ee6-8f9cd3c00727 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:27.102026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-78dca7f2-21ef-425c-8eba-79981c4034a0 req-0fc31b56-329a-4889-9ee6-8f9cd3c00727 service nova] Creating event network-changed:d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f for instance 860762bc-50d2-469d-867b-79f2189ebd21 on hv-cinder-78693 Apr 20 19:26:27.107915 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-78dca7f2-21ef-425c-8eba-79981c4034a0 req-0fc31b56-329a-4889-9ee6-8f9cd3c00727 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050128 Apr 20 19:26:27.108618 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 515/1036] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:27.601502 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:27.602225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:27.610553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:27.611067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:27.611942 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:27.612458 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:27.924854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:27.934225 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-4ac034ce-cb6f-4ac5-a075-ed0960498e68 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.336748 Apr 20 19:26:27.935057 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 522/1037] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:27 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:28.953470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:28.954310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:28.963313 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:28.963831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:28.964857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:28.965350 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:29.186020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:29.195276 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-92362b21-77ec-49ab-bdbb-4c792f9422c3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.246470 Apr 20 19:26:29.195902 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 516/1038] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:28 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:30.213482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:30.214289 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:30.222779 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:30.223295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:30.224121 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:30.224617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:30.446653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:30.460632 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3c880f5c-0794-416e-883c-5d6da509af69 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.251088 Apr 20 19:26:30.461561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 523/1039] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:30 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:31.480079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:31.480928 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:31.489262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:31.489771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:31.493519 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:31.494218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:31.712262 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:31.722277 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-49b3c2ca-1686-4509-87ee-094e84f62dcf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.246386 Apr 20 19:26:31.722918 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 517/1040] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:31 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:32.741010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:32.741623 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:32.750212 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:32.750720 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:32.751557 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:32.752048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:32.980011 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:32.989306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-f6cf1bfc-8a04-47de-8d7d-3812727b08d3 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.252517 Apr 20 19:26:32.990000 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 524/1041] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:32 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:34.007661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:34.008448 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:34.017017 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:34.017620 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:34.018513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:34.018992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:34.238041 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:34.247176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84ec48bd-0bf7-4036-9e41-f9eb7c56b01e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.243683 Apr 20 19:26:34.248109 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 518/1042] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:34 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:34.517595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:26:34.518067 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:26:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:26:35.265010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:35.265680 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:35.274049 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:35.274827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:35.275778 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:35.276266 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:35.490110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:35.499437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-acde974f-1613-4308-ba8f-448b0bb68fd6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.238514 Apr 20 19:26:35.500076 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 525/1043] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:35 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:35.835744 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-6c7ca3ee-1fe5-4c1b-afa8-fa9d095d1da0 req-3872c8aa-a01b-49a0-b87d-c73a8154c6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860762bc-50d2-469d-867b-79f2189ebd21", "name": "network-vif-plugged", "status": "completed", "tag": "d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:35.837716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:35.837716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:26:35.848382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-6c7ca3ee-1fe5-4c1b-afa8-fa9d095d1da0 req-3872c8aa-a01b-49a0-b87d-c73a8154c6ae service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:35.848894 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-6c7ca3ee-1fe5-4c1b-afa8-fa9d095d1da0 req-3872c8aa-a01b-49a0-b87d-c73a8154c6ae service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:35.867592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-6c7ca3ee-1fe5-4c1b-afa8-fa9d095d1da0 req-3872c8aa-a01b-49a0-b87d-c73a8154c6ae service nova] Creating event network-vif-plugged:d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f for instance 860762bc-50d2-469d-867b-79f2189ebd21 on hv-cinder-78693 Apr 20 19:26:35.873069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-6c7ca3ee-1fe5-4c1b-afa8-fa9d095d1da0 req-3872c8aa-a01b-49a0-b87d-c73a8154c6ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042343 Apr 20 19:26:35.873906 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 519/1044] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:26:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:36.517669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:36.518518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:36.526940 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:36.527363 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:36.528301 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:36.528781 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:36.838249 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:36.848981 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-35afae2b-6cd5-4844-af3b-3e9f4c7cef90 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.335374 Apr 20 19:26:36.849596 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 526/1045] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:36 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:37.868191 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:37.868956 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:37.877460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:37.878079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:37.878845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:37.879320 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:38.093721 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:38.103259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-463b958a-fa4a-474d-b7bd-847223c4cdf2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1452 microversion: 2.1 time: 0.239677 Apr 20 19:26:38.104093 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 520/1046] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:37 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:38.120617 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:38.121284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:38.129398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:38.129925 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:38.130755 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:38.131234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:38.350731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:38.359858 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-63de4c10-e78f-4e1b-8e29-71eb0f8ab100 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1452 microversion: 2.1 time: 0.243340 Apr 20 19:26:38.360479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 527/1047] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:38 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1452 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:41.284284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-6b5d9b54-9f58-433c-af3f-be65c2abc2f6 req-d35f38c3-9496-4706-aaff-e7d4473c2d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860762bc-50d2-469d-867b-79f2189ebd21", "tag": "d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:41.286753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:41.286753 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:26:41.296182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-6b5d9b54-9f58-433c-af3f-be65c2abc2f6 req-d35f38c3-9496-4706-aaff-e7d4473c2d36 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:41.296689 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-6b5d9b54-9f58-433c-af3f-be65c2abc2f6 req-d35f38c3-9496-4706-aaff-e7d4473c2d36 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:41.315479 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-6b5d9b54-9f58-433c-af3f-be65c2abc2f6 req-d35f38c3-9496-4706-aaff-e7d4473c2d36 service nova] Creating event network-changed:d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f for instance 860762bc-50d2-469d-867b-79f2189ebd21 on hv-cinder-78693 Apr 20 19:26:41.320857 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-6b5d9b54-9f58-433c-af3f-be65c2abc2f6 req-d35f38c3-9496-4706-aaff-e7d4473c2d36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040842 Apr 20 19:26:41.321581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 521/1048] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:26:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:42.790612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:42.791144 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:42.793312 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-fa5f92f6-e3e0-4465-afa2-d63b81f1344c req-1d6b98d7-ba80-404b-affa-eadc22134eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:42.794994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:42.794994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:26:42.799495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:42.799979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:42.801026 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:42.801518 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:42.804612 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fa5f92f6-e3e0-4465-afa2-d63b81f1344c req-1d6b98d7-ba80-404b-affa-eadc22134eef service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:42.805098 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fa5f92f6-e3e0-4465-afa2-d63b81f1344c req-1d6b98d7-ba80-404b-affa-eadc22134eef service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:42.825802 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-fa5f92f6-e3e0-4465-afa2-d63b81f1344c req-1d6b98d7-ba80-404b-affa-eadc22134eef service nova] Creating event network-changed:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:26:42.831163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-fa5f92f6-e3e0-4465-afa2-d63b81f1344c req-1d6b98d7-ba80-404b-affa-eadc22134eef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042303 Apr 20 19:26:42.831810 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 522/1049] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:26:42.871367 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Going to try to terminate instance {{(pid=100514) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:26:43.019910 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5d704aa-01f2-43cd-93fe-57ae02539f06 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 204 len: 0 microversion: 2.1 time: 0.233512 Apr 20 19:26:43.021129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 528/1050] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:26:42 2021] DELETE /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:26:43.030466 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:43.031681 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:43.043582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:43.044447 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:43.045507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:43.046234 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:43.882667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:43.895335 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9d6fd613-47ba-4fc1-8eb3-08a2dcb1a368 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1568 microversion: 2.1 time: 0.869523 Apr 20 19:26:43.896686 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 523/1051] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:43 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1568 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:44.916340 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:44.917148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:44.925739 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:44.926371 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:44.927105 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:44.927836 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:45.428452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:45.442375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b1df4cab-6c27-4601-a98e-125872b8b286 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1449 microversion: 2.1 time: 0.530735 Apr 20 19:26:45.443213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 529/1052] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:44 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1449 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:45.513992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-8d719709-fda0-41d9-ba1c-14a67f3e7f07 req-2c49a53a-bcd7-466e-8e00-950abde9b6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7421ebd2-8f97-47a6-a7e9-b1042cb214f8", "name": "network-vif-deleted", "tag": "88ef5465-6e4e-4fe5-b043-b8f0d3395202"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:26:45.515684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:45.515684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:26:45.531141 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8d719709-fda0-41d9-ba1c-14a67f3e7f07 req-2c49a53a-bcd7-466e-8e00-950abde9b6ea service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:45.531733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-8d719709-fda0-41d9-ba1c-14a67f3e7f07 req-2c49a53a-bcd7-466e-8e00-950abde9b6ea service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:45.550176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-8d719709-fda0-41d9-ba1c-14a67f3e7f07 req-2c49a53a-bcd7-466e-8e00-950abde9b6ea service nova] Creating event network-vif-deleted:88ef5465-6e4e-4fe5-b043-b8f0d3395202 for instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 on hv-cinder-78693 Apr 20 19:26:45.556020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-8d719709-fda0-41d9-ba1c-14a67f3e7f07 req-2c49a53a-bcd7-466e-8e00-950abde9b6ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046538 Apr 20 19:26:45.556740 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 524/1053] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:26:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:46.463441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:46.464401 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:46.472568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:46.473441 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:46.474285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:46.474800 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:46.551457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:46.551965 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:46.552477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.objects.instance [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lazy-loading 'fault' on Instance uuid 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 {{(pid=100514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:26:46.635369 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f755244a7431eaa5670a470d58ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d968355d63345bb88225895ff82e482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:26:46.644640 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-88211fb3-a596-48b8-bfa4-1a99e63c82b4 tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 200 len: 1225 microversion: 2.1 time: 0.186826 Apr 20 19:26:46.645559 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 530/1054] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:46 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:26:47.669343 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:47.670554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] [instance: 7421ebd2-8f97-47a6-a7e9-b1042cb214f8] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:26:47.683787 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:47.684292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:47.685132 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:47.685625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:47.738606 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] HTTP exception thrown: Instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 could not be found. Apr 20 19:26:47.739295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Returning 404 to user: Instance 7421ebd2-8f97-47a6-a7e9-b1042cb214f8 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:26:47.740206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-869a4d76-a078-4b8b-82ba-ccfbc663217e tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8" status: 404 len: 111 microversion: 2.1 time: 0.078983 Apr 20 19:26:47.740831 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 525/1055] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:26:47 2021] GET /compute/v2.1/servers/7421ebd2-8f97-47a6-a7e9-b1042cb214f8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:26:47.948646 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-09105e6f-e822-4959-a0bd-8462777161ee tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] Calling method '.version_select at 0x7fd8e164f0d0>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:47.966966 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-09105e6f-e822-4959-a0bd-8462777161ee tempest-TestShelveInstance-1005070175 tempest-TestShelveInstance-1005070175-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093278997" status: 202 len: 0 microversion: 2.1 time: 0.022408 Apr 20 19:26:47.967598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 531/1056] 10.222.0.48 () {58 vars in 1244 bytes} [Tue Apr 20 19:26:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093278997 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:27:42.525167 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:27:42.526155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:27:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:28:30.689272 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:30.689951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:30.693567 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abfe6dda-1404-487f-b3e3-da9cd9df70e9] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:28:30.699338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:30.699843 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:30.700696 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:30.701199 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:30.769493 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:28:30.891339 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0d354191-2d12-4852-8bb8-8f43b653c95c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "DELETE /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 204 len: 0 microversion: 2.1 time: 0.205959 Apr 20 19:28:30.891992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 526/1057] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:28:30 2021] DELETE /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:28:30.903265 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:30.903926 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:30.913573 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:30.914135 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:30.915022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:30.915515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:31.297707 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:31.307172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-7d13f5da-cf9b-40c1-9f4e-9d8ce0281c91 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1577 microversion: 2.1 time: 0.409049 Apr 20 19:28:31.307818 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 532/1058] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:30 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1577 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:32.335965 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:32.336722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:32.361727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] [abfe6dda-1404-487f-b3e3-da9cd9df70e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56174. Apr 20 19:28:32.363246 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:32.363798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:32.364670 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:32.365168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:32.954927 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:32.964460 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d4469fe1-5530-4257-91dd-bf1633555978 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1577 microversion: 2.1 time: 0.633184 Apr 20 19:28:32.965094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 527/1059] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:32 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1577 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:34.001416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:34.003137 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:34.012165 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:34.013068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:34.014079 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:34.014671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:34.201027 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-19752054-217f-4b08-adb1-ee64914db67f req-2bd172c0-1900-4e9c-abb3-584b4fa6397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860762bc-50d2-469d-867b-79f2189ebd21", "name": "network-vif-deleted", "tag": "d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:34.207359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:28:34.207359 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:28:34.208803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:34.219577 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c5b6b8ff-bdb0-467f-bf07-f959b3976d31 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 200 len: 1509 microversion: 2.1 time: 0.229993 Apr 20 19:28:34.220541 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 533/1060] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:33 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:34.222520 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-19752054-217f-4b08-adb1-ee64914db67f req-2bd172c0-1900-4e9c-abb3-584b4fa6397b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:34.223116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-19752054-217f-4b08-adb1-ee64914db67f req-2bd172c0-1900-4e9c-abb3-584b4fa6397b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:34.243362 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-19752054-217f-4b08-adb1-ee64914db67f req-2bd172c0-1900-4e9c-abb3-584b4fa6397b service nova] Creating event network-vif-deleted:d1c3b1ec-a14d-41dc-9fe8-1c26a5edab0f for instance 860762bc-50d2-469d-867b-79f2189ebd21 on hv-cinder-78693 Apr 20 19:28:34.248653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-19752054-217f-4b08-adb1-ee64914db67f req-2bd172c0-1900-4e9c-abb3-584b4fa6397b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124958 Apr 20 19:28:34.249315 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 528/1061] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:28:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:35.256997 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:35.258664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:35.277213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:35.277725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:35.278605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:35.279083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:35.335486 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] HTTP exception thrown: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. Apr 20 19:28:35.336188 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Returning 404 to user: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:28:35.337077 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-fe225042-56ef-4d14-9080-6dabd319d69a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 404 len: 111 microversion: 2.1 time: 0.088171 Apr 20 19:28:35.337693 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 534/1062] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:35 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:28:35.489481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1429868294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63752255", "security_groups": [{"name": "tempest-secgroup-smoke-1956524667"}], "block_device_mapping_v2": [{"uuid": "ffcfc12f-09c4-47f4-a451-cde2b1a4e768", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ab03e81-f151-4ff5-bd7e-2e4ac4930244"}]}} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:35.707282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] validate_networks() for [('3ab03e81-f151-4ff5-bd7e-2e4ac4930244', None, None, None)] {{(pid=100515) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:28:36.458794 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:28:36.459556 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image limits 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:28:36.460259 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:28:36.460859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image pref 0:0:0 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:28:36.461357 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100515) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:28:36.471007 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:36.471436 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:36.472338 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:36.472833 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:36.492699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:28:36.497177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for user 3ece67f51abc4ee487279f8966d80949 and project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100515) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:28:36.617771 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Going to run 1 instances... {{(pid=100515) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:28:36.620586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ffcfc12f-09c4-47f4-a451-cde2b1a4e768',volume_size=None,volume_type=None)] {{(pid=100515) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:28:36.830217 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-744b9b1f-d716-4d74-9be5-a290d0dca8a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.345348 Apr 20 19:28:36.831282 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 529/1063] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:28:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:28:36.842980 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9687ddc4-4560-445f-8a35-6f5e2de389bf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:36.843691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9687ddc4-4560-445f-8a35-6f5e2de389bf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:36.847149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a4e75dd-ecf8-4d5a-aa6b-022d1acf5363] AMQP server on 10.222.0.48:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 20 19:28:36.930116 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9687ddc4-4560-445f-8a35-6f5e2de389bf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:36.939561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9687ddc4-4560-445f-8a35-6f5e2de389bf tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1093 microversion: 2.1 time: 0.101017 Apr 20 19:28:36.940224 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 535/1064] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:36 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:37.959528 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:37.960200 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:37.969664 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:37.970203 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:37.971183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:37.971685 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:38.120651 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:38.137342 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-c06d8670-efa5-430a-9b76-a35ed12fe045 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1191 microversion: 2.1 time: 0.182048 Apr 20 19:28:38.138489 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 530/1065] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:37 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1191 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:39.160112 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:39.161385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:39.184347 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:39.184853 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:39.185699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:39.186218 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:39.223389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a4e75dd-ecf8-4d5a-aa6b-022d1acf5363] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56218. Apr 20 19:28:39.545821 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:39.559001 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df8f150f-142f-4146-b87c-715cd69cde28 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.406366 Apr 20 19:28:39.559627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 536/1066] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:39 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:40.581568 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:40.582285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:40.596300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:40.597099 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:40.598728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:40.600129 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:40.875269 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-a97f8521-42f3-4f99-8a9b-4982a442975b req-e78e3498-5c07-441f-921d-2ff45616cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b938c5b0-0c3c-465a-a592-f1bd93957595", "tag": "a379d3e3-9042-4c9a-b554-a2cb693f9e7d"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:40.877073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:28:40.877073 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:28:40.892163 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-a97f8521-42f3-4f99-8a9b-4982a442975b req-e78e3498-5c07-441f-921d-2ff45616cbf9 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:40.892709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-a97f8521-42f3-4f99-8a9b-4982a442975b req-e78e3498-5c07-441f-921d-2ff45616cbf9 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:40.917582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-a97f8521-42f3-4f99-8a9b-4982a442975b req-e78e3498-5c07-441f-921d-2ff45616cbf9 service nova] Creating event network-changed:a379d3e3-9042-4c9a-b554-a2cb693f9e7d for instance b938c5b0-0c3c-465a-a592-f1bd93957595 on hv-cinder-78693 Apr 20 19:28:40.927331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-a97f8521-42f3-4f99-8a9b-4982a442975b req-e78e3498-5c07-441f-921d-2ff45616cbf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055710 Apr 20 19:28:40.927331 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 537/1067] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:28:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:41.155662 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:41.165238 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-df74d2eb-87b8-4fd1-9c28-61e5e6bc20d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.588150 Apr 20 19:28:41.166186 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 531/1068] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:40 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:42.190290 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:42.191215 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:42.200773 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:42.201391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:42.202281 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:42.202788 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:42.582285 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:42.596661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9f0bb36f-2fec-4d50-a9c6-23aaff37bb96 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.410545 Apr 20 19:28:42.597814 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 538/1069] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:42 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:43.616789 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:43.617457 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:43.626209 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:43.626725 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:43.627904 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:43.628571 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:43.863538 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:43.876438 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dad7417c-20fe-4b1f-8cfd-544067bc8fca tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.263448 Apr 20 19:28:43.877078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 532/1070] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:43 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:44.895897 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:44.896555 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:44.907628 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:44.908412 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:44.909793 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:44.910499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:45.145998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:45.155168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1bde7fb5-5fd6-4cf8-b188-3e531036d85e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.263551 Apr 20 19:28:45.155796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 539/1071] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:44 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:46.175437 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:46.176177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:46.184687 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:46.185195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:46.186078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:46.186582 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:46.421803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:46.431236 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-06536783-4447-45e9-9dfb-3f4a7a5ec82c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.261800 Apr 20 19:28:46.431865 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 533/1072] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:46 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:47.452392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:47.453151 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:47.461610 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:47.462145 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:47.462994 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:47.463480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:47.692723 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:47.703747 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1f34b926-13b9-4018-ab56-810b1f8acbfd tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.255383 Apr 20 19:28:47.704294 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 540/1073] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:47 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:48.723083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:48.723759 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:48.732745 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:48.733254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:48.734172 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:48.734665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:48.976869 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:48.993516 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-08c322eb-f5a8-47fa-adda-c954810616d0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.274272 Apr 20 19:28:48.994848 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 534/1074] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:48 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:50.022352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:50.023094 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:50.034115 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:50.034859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:50.036055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:50.036619 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:50.288983 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:50.302826 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-d679abe1-2cbf-4865-a8ba-4c00a155b453 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.284920 Apr 20 19:28:50.303497 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 541/1075] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:50 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:50.604275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-350710ae-baf0-486c-bedc-05c1a8f275d5 req-97132872-89b5-4461-8724-ddc02a9360e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b938c5b0-0c3c-465a-a592-f1bd93957595", "name": "network-vif-plugged", "status": "completed", "tag": "a379d3e3-9042-4c9a-b554-a2cb693f9e7d"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:50.606231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:28:50.606231 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:28:50.616064 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-350710ae-baf0-486c-bedc-05c1a8f275d5 req-97132872-89b5-4461-8724-ddc02a9360e1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:50.616594 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-350710ae-baf0-486c-bedc-05c1a8f275d5 req-97132872-89b5-4461-8724-ddc02a9360e1 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:50.636297 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-350710ae-baf0-486c-bedc-05c1a8f275d5 req-97132872-89b5-4461-8724-ddc02a9360e1 service nova] Creating event network-vif-plugged:a379d3e3-9042-4c9a-b554-a2cb693f9e7d for instance b938c5b0-0c3c-465a-a592-f1bd93957595 on hv-cinder-78693 Apr 20 19:28:50.642629 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-350710ae-baf0-486c-bedc-05c1a8f275d5 req-97132872-89b5-4461-8724-ddc02a9360e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116110 Apr 20 19:28:50.643310 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 535/1076] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:28:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:51.326643 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:51.327499 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:51.341210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:51.341979 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:51.342868 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:51.343382 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:51.580399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:51.590031 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-351d8cfb-ed8b-4102-81ca-ad4210bfb7f2 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1265 microversion: 2.1 time: 0.269420 Apr 20 19:28:51.590661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 542/1077] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:51 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:52.610727 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:52.613637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:52.623835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:52.624346 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:52.625356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:52.625871 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:52.868254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:52.878815 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-9a641cb3-8e40-4823-9c87-e31203621dd5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1453 microversion: 2.1 time: 0.273023 Apr 20 19:28:52.879418 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 536/1078] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:52 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1453 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:52.899275 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:52.899945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:28:52.909376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:52.909951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:52.910911 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:52.911409 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:53.153625 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:28:53.164532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b68676d6-79a4-4d9b-8e26-44e9a7624edc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1453 microversion: 2.1 time: 0.270253 Apr 20 19:28:53.165169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 543/1079] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:28:52 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1453 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:28:56.247377 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-f6dd1f1c-b9be-4d4f-b574-57fff1f27763 req-0df7cb0e-8b48-4e02-8b39-0ecffa75acbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b938c5b0-0c3c-465a-a592-f1bd93957595", "tag": "a379d3e3-9042-4c9a-b554-a2cb693f9e7d"}]} {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:56.249158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:28:56.249158 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:28:56.259182 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f6dd1f1c-b9be-4d4f-b574-57fff1f27763 req-0df7cb0e-8b48-4e02-8b39-0ecffa75acbb service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:56.259819 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-f6dd1f1c-b9be-4d4f-b574-57fff1f27763 req-0df7cb0e-8b48-4e02-8b39-0ecffa75acbb service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:56.279608 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-f6dd1f1c-b9be-4d4f-b574-57fff1f27763 req-0df7cb0e-8b48-4e02-8b39-0ecffa75acbb service nova] Creating event network-changed:a379d3e3-9042-4c9a-b554-a2cb693f9e7d for instance b938c5b0-0c3c-465a-a592-f1bd93957595 on hv-cinder-78693 Apr 20 19:28:56.285859 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-f6dd1f1c-b9be-4d4f-b574-57fff1f27763 req-0df7cb0e-8b48-4e02-8b39-0ecffa75acbb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111628 Apr 20 19:28:56.286691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 537/1080] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:28:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:32.430470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:29:32.431375 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:29:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:29:54.545394 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:29:54.546117 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:29:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:30:32.516383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-450213445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63752255", "security_groups": [{"name": "tempest-secgroup-smoke-1956524667"}], "block_device_mapping_v2": [{"uuid": "6a81a0a4-4ae5-48c6-8b5f-92ccd747f033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ab03e81-f151-4ff5-bd7e-2e4ac4930244"}]}} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:32.695713 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.network.neutron [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] validate_networks() for [('3ab03e81-f151-4ff5-bd7e-2e4ac4930244', None, None, None)] {{(pid=100514) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:30:33.432586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:30:33.433055 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image limits 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:30:33.433585 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Flavor pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:30:33.434100 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Image pref 0:0:0 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:30:33.434603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.virt.hardware [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:30:33.444174 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:33.444675 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:33.445534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:33.446048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:33.465553 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:30:33.470811 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.quota [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Getting quotas for user 3ece67f51abc4ee487279f8966d80949 and project 246961ea5c484b7d8d9f3e2ae5c3cbaa. Resources: {'ram', 'cores', 'instances'} {{(pid=100514) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:30:33.589599 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Going to run 1 instances... {{(pid=100514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:30:33.592798 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a81a0a4-4ae5-48c6-8b5f-92ccd747f033',volume_size=None,volume_type=None)] {{(pid=100514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:30:33.778738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2a953995-5620-4e05-98e5-1e50be5ce442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.266882 Apr 20 19:30:33.780354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 544/1081] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Apr 20 19:30:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:30:33.789334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [abfe6dda-1404-487f-b3e3-da9cd9df70e9] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 20 19:30:33.793398 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6b1b15fe-fd4b-4106-8922-38bf5b509314 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:33.794270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6b1b15fe-fd4b-4106-8922-38bf5b509314 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:33.877196 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6b1b15fe-fd4b-4106-8922-38bf5b509314 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:33.888534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6b1b15fe-fd4b-4106-8922-38bf5b509314 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1092 microversion: 2.1 time: 0.101844 Apr 20 19:30:33.889263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 538/1082] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:33 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1092 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:34.908303 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:34.908969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:34.918119 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.918631 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.919671 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.920170 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.079874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:35.090038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-352b9594-d544-44e2-a269-41e1be4fdbc6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1208 microversion: 2.1 time: 0.186270 Apr 20 19:30:35.091929 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 545/1083] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:34 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:36.109576 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:36.110247 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:36.129477 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.130008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.130860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.131351 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.190328 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] [abfe6dda-1404-487f-b3e3-da9cd9df70e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56346. Apr 20 19:30:36.548239 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:36.558621 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dc6a8fee-94d1-4cd1-8b4b-9bb32043b546 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.453195 Apr 20 19:30:36.559255 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 539/1084] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:36 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:37.283796 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-d08de139-5062-486b-bbe1-0ed7a93497ca req-29ce0a58-6669-4ae6-9223-c4613befc6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e795d8-7de7-4c90-be0a-6298d2c7c6b5", "tag": "4d976be1-400e-4653-82d0-34a4cd3746e5"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:37.286311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:37.286311 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:30:37.298445 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d08de139-5062-486b-bbe1-0ed7a93497ca req-29ce0a58-6669-4ae6-9223-c4613befc6d4 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.298992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-d08de139-5062-486b-bbe1-0ed7a93497ca req-29ce0a58-6669-4ae6-9223-c4613befc6d4 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.319951 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-d08de139-5062-486b-bbe1-0ed7a93497ca req-29ce0a58-6669-4ae6-9223-c4613befc6d4 service nova] Creating event network-changed:4d976be1-400e-4653-82d0-34a4cd3746e5 for instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 on hv-cinder-78693 Apr 20 19:30:37.326034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-d08de139-5062-486b-bbe1-0ed7a93497ca req-29ce0a58-6669-4ae6-9223-c4613befc6d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048139 Apr 20 19:30:37.327083 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 546/1085] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:37.577284 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:37.578004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:37.586600 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.587110 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.588280 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.589016 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.016748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:38.026861 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-b33d087a-81bc-45a6-8260-b61ac738d6d6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.453627 Apr 20 19:30:38.027554 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 540/1086] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:37 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:39.048974 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:39.049699 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:39.062691 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.063048 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.064419 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.065210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.316390 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:39.326233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-dbb02bc6-4349-4906-8e41-ac4ba5f9b4a4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.284317 Apr 20 19:30:39.326860 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 547/1087] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:39 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:40.345945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:40.346507 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:40.354665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:40.355169 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:40.356009 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:40.356495 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:40.590066 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:40.599823 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e868ffcb-4699-4fc0-b4cb-d619240f3592 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.258613 Apr 20 19:30:40.600389 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 541/1088] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:40 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:41.620204 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:41.620839 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:41.632233 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.632879 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.634268 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.635040 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.866177 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:41.876364 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-3c3433fd-f782-411d-855d-c9deb0ae2d22 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.260450 Apr 20 19:30:41.876948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 548/1089] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:41 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:42.894977 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:42.895653 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:42.904006 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.904543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:42.905391 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.905874 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.124206 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:43.133402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-2dcfbbb2-dc6b-4363-85e4-a65f8c882b7f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.242686 Apr 20 19:30:43.134010 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 542/1090] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:42 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:44.151611 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:44.152383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:44.162827 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.163334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.164176 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.164666 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.539588 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:44.551008 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-1132efae-14f7-44de-b04d-8664e113863b tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.403456 Apr 20 19:30:44.551700 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 549/1091] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:44 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:45.570484 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:45.571183 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:45.580148 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.580630 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.581506 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.582025 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.819053 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:45.829532 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-63605098-d7d9-45bf-b9e7-770bf6fccd5e tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.263087 Apr 20 19:30:45.830069 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 543/1092] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:45 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:46.851603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:46.852211 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:46.860803 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.861306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.862327 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.862808 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:47.100969 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:47.110308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-437fd258-a247-4380-9d79-958a303b5aa9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.262847 Apr 20 19:30:47.110989 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 550/1093] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:46 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:48.132835 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:48.133880 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:48.144791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.145307 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.146228 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.146731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.403509 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:48.414992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0b19663a-c308-40b8-ad09-9f4f4835cb71 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.289854 Apr 20 19:30:48.415847 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 544/1094] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:48 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:49.054431 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-ba1ed3bd-cf7c-43ac-8320-c11ab48dc174 req-7f30b0a3-1e03-4402-8992-0bcf036f7b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e795d8-7de7-4c90-be0a-6298d2c7c6b5", "name": "network-vif-plugged", "status": "completed", "tag": "4d976be1-400e-4653-82d0-34a4cd3746e5"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:49.056452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:49.056452 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:30:49.067244 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ba1ed3bd-cf7c-43ac-8320-c11ab48dc174 req-7f30b0a3-1e03-4402-8992-0bcf036f7b2b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.067635 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-ba1ed3bd-cf7c-43ac-8320-c11ab48dc174 req-7f30b0a3-1e03-4402-8992-0bcf036f7b2b service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.086480 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-ba1ed3bd-cf7c-43ac-8320-c11ab48dc174 req-7f30b0a3-1e03-4402-8992-0bcf036f7b2b service nova] Creating event network-vif-plugged:4d976be1-400e-4653-82d0-34a4cd3746e5 for instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 on hv-cinder-78693 Apr 20 19:30:49.092855 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-ba1ed3bd-cf7c-43ac-8320-c11ab48dc174 req-7f30b0a3-1e03-4402-8992-0bcf036f7b2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042110 Apr 20 19:30:49.093678 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 551/1095] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:49.434084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:49.434728 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:49.442890 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.443399 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.444241 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.444729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.668591 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:49.678273 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-6d8993b2-00e1-43a6-b33e-b12ee800c580 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1264 microversion: 2.1 time: 0.248325 Apr 20 19:30:49.679022 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 545/1096] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:49 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:50.698291 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:50.699054 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:50.707634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:50.708136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:50.708961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:50.709444 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:50.922669 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:50.932127 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-994810fd-428d-4b2d-913a-6e5b565c4fb6 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1451 microversion: 2.1 time: 0.238744 Apr 20 19:30:50.932738 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 552/1097] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:50 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1451 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:50.952080 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:50.952676 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:50.961883 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:50.962414 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:50.963242 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:50.963729 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:51.190949 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:51.200748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-375ec865-b693-497b-a7a2-95ad2f7d6dcc tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1451 microversion: 2.1 time: 0.253325 Apr 20 19:30:51.201376 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 546/1098] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:50 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1451 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:53.578396 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:30:53.578995 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:30:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:30:54.526845 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-fdf8a33c-05e1-4b67-ac36-42fdd19c8cfc req-ff3c99d5-ac70-4b03-926a-550eca34fddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e795d8-7de7-4c90-be0a-6298d2c7c6b5", "tag": "4d976be1-400e-4653-82d0-34a4cd3746e5"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:54.528580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:54.528580 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:30:54.539227 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fdf8a33c-05e1-4b67-ac36-42fdd19c8cfc req-ff3c99d5-ac70-4b03-926a-550eca34fddf service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:54.539683 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-fdf8a33c-05e1-4b67-ac36-42fdd19c8cfc req-ff3c99d5-ac70-4b03-926a-550eca34fddf service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:54.563971 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-fdf8a33c-05e1-4b67-ac36-42fdd19c8cfc req-ff3c99d5-ac70-4b03-926a-550eca34fddf service nova] Creating event network-changed:4d976be1-400e-4653-82d0-34a4cd3746e5 for instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 on hv-cinder-78693 Apr 20 19:30:54.569784 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-fdf8a33c-05e1-4b67-ac36-42fdd19c8cfc req-ff3c99d5-ac70-4b03-926a-550eca34fddf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046808 Apr 20 19:30:54.571385 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 553/1099] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:28.725250 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a4e75dd-ecf8-4d5a-aa6b-022d1acf5363] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:32:28.725919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:28.725919 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:28.729352 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-684b19a4-13ff-4eb9-b3c1-b21b5009f92b req-f43bfecd-01c8-4fea-b22c-2cce78b8d068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e795d8-7de7-4c90-be0a-6298d2c7c6b5", "tag": "4d976be1-400e-4653-82d0-34a4cd3746e5"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:28.731085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:28.731085 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:32:28.733953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.734461 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.735295 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.735854 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.740804 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-684b19a4-13ff-4eb9-b3c1-b21b5009f92b req-f43bfecd-01c8-4fea-b22c-2cce78b8d068 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.741306 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-684b19a4-13ff-4eb9-b3c1-b21b5009f92b req-f43bfecd-01c8-4fea-b22c-2cce78b8d068 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.759572 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-684b19a4-13ff-4eb9-b3c1-b21b5009f92b req-f43bfecd-01c8-4fea-b22c-2cce78b8d068 service nova] Creating event network-changed:4d976be1-400e-4653-82d0-34a4cd3746e5 for instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 on hv-cinder-78693 Apr 20 19:32:28.765118 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-684b19a4-13ff-4eb9-b3c1-b21b5009f92b req-f43bfecd-01c8-4fea-b22c-2cce78b8d068 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041264 Apr 20 19:32:28.765752 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 554/1100] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:28.805799 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:29.094592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-bd407d0a-599a-4f0a-9f05-dd68c772817f tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 204 len: 0 microversion: 2.1 time: 0.372808 Apr 20 19:32:29.095470 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 547/1101] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:28 2021] DELETE /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:29.105581 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:29.106561 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:29.115948 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.116634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.117515 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.118034 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.376392 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:29.387592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-cc287d69-edfd-47fe-8f22-1fe72805bb42 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1575 microversion: 2.1 time: 0.286029 Apr 20 19:32:29.388469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 555/1102] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:29 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1575 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:30.407637 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:30.408324 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:30.416508 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:30.417013 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:30.417898 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:30.418383 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:30.637037 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.646510 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-e3ed34a9-ba3f-43e5-83eb-0fb70e62e1c0 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1457 microversion: 2.1 time: 0.243594 Apr 20 19:32:30.647131 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 548/1103] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:30 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1457 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:31.622586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-89866036-557d-4ff6-bb54-bfd6d91eddee req-13f6685e-3c7c-434c-8468-75c838ea0b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e795d8-7de7-4c90-be0a-6298d2c7c6b5", "name": "network-vif-deleted", "tag": "4d976be1-400e-4653-82d0-34a4cd3746e5"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:31.625464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:31.625464 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:32:31.651731 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-89866036-557d-4ff6-bb54-bfd6d91eddee req-13f6685e-3c7c-434c-8468-75c838ea0b8f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.652226 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-89866036-557d-4ff6-bb54-bfd6d91eddee req-13f6685e-3c7c-434c-8468-75c838ea0b8f service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.665517 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:31.666214 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:31.669544 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a4e75dd-ecf8-4d5a-aa6b-022d1acf5363] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56422. Apr 20 19:32:31.671513 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-89866036-557d-4ff6-bb54-bfd6d91eddee req-13f6685e-3c7c-434c-8468-75c838ea0b8f service nova] Creating event network-vif-deleted:4d976be1-400e-4653-82d0-34a4cd3746e5 for instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 on hv-cinder-78693 Apr 20 19:32:31.676416 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-89866036-557d-4ff6-bb54-bfd6d91eddee req-13f6685e-3c7c-434c-8468-75c838ea0b8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058028 Apr 20 19:32:31.676737 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.677106 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 556/1104] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:31.677481 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.678586 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.679149 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.809733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:31.824020 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-38c3782a-769a-4c43-bda2-2693b0f3a9a5 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 200 len: 1223 microversion: 2.1 time: 0.162287 Apr 20 19:32:31.824953 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 549/1105] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:31 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:32.850213 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:32.851467 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: e5e795d8-7de7-4c90-be0a-6298d2c7c6b5] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:32.865408 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.866341 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:32.867724 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.868534 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:32.934992 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] HTTP exception thrown: Instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 could not be found. Apr 20 19:32:32.936078 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Returning 404 to user: Instance e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:32.937543 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5e232410-32ba-4d93-86ba-51d107cd031a tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5" status: 404 len: 111 microversion: 2.1 time: 0.095254 Apr 20 19:32:32.938616 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 557/1106] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:32 2021] GET /compute/v2.1/servers/e5e795d8-7de7-4c90-be0a-6298d2c7c6b5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:37.165578 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:37.166160 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:37.169155 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-390a15bd-c634-469b-96a5-899f8d09303f req-74499845-84f1-44dc-a932-fb7a5cfc1407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b938c5b0-0c3c-465a-a592-f1bd93957595", "tag": "a379d3e3-9042-4c9a-b554-a2cb693f9e7d"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:37.171043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:37.171043 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:32:37.174195 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.174716 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.175598 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.176091 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.180705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-390a15bd-c634-469b-96a5-899f8d09303f req-74499845-84f1-44dc-a932-fb7a5cfc1407 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.181469 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-390a15bd-c634-469b-96a5-899f8d09303f req-74499845-84f1-44dc-a932-fb7a5cfc1407 service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.199945 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-390a15bd-c634-469b-96a5-899f8d09303f req-74499845-84f1-44dc-a932-fb7a5cfc1407 service nova] Creating event network-changed:a379d3e3-9042-4c9a-b554-a2cb693f9e7d for instance b938c5b0-0c3c-465a-a592-f1bd93957595 on hv-cinder-78693 Apr 20 19:32:37.206881 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-390a15bd-c634-469b-96a5-899f8d09303f req-74499845-84f1-44dc-a932-fb7a5cfc1407 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041833 Apr 20 19:32:37.207735 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 558/1107] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:37.241792 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Going to try to terminate instance {{(pid=100515) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:37.359900 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-62b7a112-46ae-4607-9636-5e07f3733c30 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 204 len: 0 microversion: 2.1 time: 0.197933 Apr 20 19:32:37.360548 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:37 2021] DELETE /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:37.370354 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:37.371120 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:37.379411 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.379921 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.380761 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.381254 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.623863 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100514) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:37.633603 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-84b786fc-2e29-475c-89eb-b0b29e2be442 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1577 microversion: 2.1 time: 0.267891 Apr 20 19:32:37.634300 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 559/1109] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:37 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1577 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:38.653500 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:38.654442 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:38.662891 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:38.663404 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:38.664287 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:38.664748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:38.886412 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:38.895712 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-902c1da4-628e-4822-bd59-407a9791e642 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1459 microversion: 2.1 time: 0.246982 Apr 20 19:32:38.896292 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 551/1110] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:38 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:39.738665 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [req-752c7ff6-5be7-42f5-95e4-70965c86b879 req-0b834e73-07c5-4610-8a62-3d564606e79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b938c5b0-0c3c-465a-a592-f1bd93957595", "name": "network-vif-deleted", "tag": "a379d3e3-9042-4c9a-b554-a2cb693f9e7d"}]} {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:39.740592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:39.740592 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: warnings.warn(msg) Apr 20 19:32:39.749733 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-752c7ff6-5be7-42f5-95e4-70965c86b879 req-0b834e73-07c5-4610-8a62-3d564606e79e service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.750263 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [req-752c7ff6-5be7-42f5-95e4-70965c86b879 req-0b834e73-07c5-4610-8a62-3d564606e79e service nova] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.773674 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.compute.server_external_events [req-752c7ff6-5be7-42f5-95e4-70965c86b879 req-0b834e73-07c5-4610-8a62-3d564606e79e service nova] Creating event network-vif-deleted:a379d3e3-9042-4c9a-b554-a2cb693f9e7d for instance b938c5b0-0c3c-465a-a592-f1bd93957595 on hv-cinder-78693 Apr 20 19:32:39.779005 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [req-752c7ff6-5be7-42f5-95e4-70965c86b879 req-0b834e73-07c5-4610-8a62-3d564606e79e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044812 Apr 20 19:32:39.779667 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 560/1111] 10.222.0.48 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:39.916488 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:39.917429 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:39.929038 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.929768 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.931019 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.931722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:40.063210 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.policy [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ece67f51abc4ee487279f8966d80949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246961ea5c484b7d8d9f3e2ae5c3cbaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100515) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:40.079917 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-0d8ac628-a23c-48c1-85a1-64b1fd6bf2d9 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 200 len: 1224 microversion: 2.1 time: 0.169283 Apr 20 19:32:40.081684 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:39 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:41.099395 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:41.100125 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: b938c5b0-0c3c-465a-a592-f1bd93957595] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:41.108772 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.109270 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.110136 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.110626 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.164039 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] HTTP exception thrown: Instance b938c5b0-0c3c-465a-a592-f1bd93957595 could not be found. Apr 20 19:32:41.164705 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Returning 404 to user: Instance b938c5b0-0c3c-465a-a592-f1bd93957595 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:41.165595 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-46738588-3517-4439-9aa4-675e32f98634 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595" status: 404 len: 111 microversion: 2.1 time: 0.070902 Apr 20 19:32:41.166308 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 561/1113] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:41 2021] GET /compute/v2.1/servers/b938c5b0-0c3c-465a-a592-f1bd93957595 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:41.990168 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:41.990722 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100515) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:41.998916 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.999423 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.000261 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:42.000748 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100515) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.053323 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] HTTP exception thrown: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. Apr 20 19:32:42.053998 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Returning 404 to user: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. {{(pid=100515) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:42.054950 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-5f14a9fd-c9e9-4adf-abec-ccd9d22a58b4 tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "DELETE /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 404 len: 111 microversion: 2.1 time: 0.069779 Apr 20 19:32:42.055849 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 553/1114] 10.222.0.48 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:41 2021] DELETE /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:42.064579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '>' {{(pid=100514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:42.065222 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.compute.api [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] [instance: 860762bc-50d2-469d-867b-79f2189ebd21] Fetching instance by UUID {{(pid=100514) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:42.073322 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:42.073805 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.074634 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:42.075482 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG oslo_concurrency.lockutils [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Lock "cecd9116-c8b8-41d1-8929-5acfc4f1558c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100514) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.127278 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.wsgi [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] HTTP exception thrown: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. Apr 20 19:32:42.128068 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Returning 404 to user: Instance 860762bc-50d2-469d-867b-79f2189ebd21 could not be found. {{(pid=100514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:42.128961 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-670d2178-1f6d-425f-ac19-906ff985907c tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21" status: 404 len: 111 microversion: 2.1 time: 0.068502 Apr 20 19:32:42.129605 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100514|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:42 2021] GET /compute/v2.1/servers/860762bc-50d2-469d-867b-79f2189ebd21 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:42.554402 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:32:42.554627 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:32:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:32:43.623791 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: DEBUG nova.api.openstack.wsgi [None req-549c392b-39c4-4abf-b555-14321a556e3d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] Calling method '.version_select at 0x7fd8e00e51e0>' {{(pid=100515) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:43.644579 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO nova.api.openstack.requestlog [None req-549c392b-39c4-4abf-b555-14321a556e3d tempest-TestVolumeBootPattern-27452075 tempest-TestVolumeBootPattern-27452075-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63752255" status: 202 len: 0 microversion: 2.1 time: 0.024917 Apr 20 19:32:43.645240 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: [pid: 100515|app: 0|req: 554/1116] 10.222.0.48 () {58 vars in 1247 bytes} [Tue Apr 20 19:32:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63752255 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:32:52.455084 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:32:52.455709 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:32:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:34:13.597884 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:34:13.598661 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:34:54.567114 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:34:54.568004 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:34:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:36:02.572565 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:36:02.573286 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:36:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:36:12.474318 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:36:12.474913 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:36:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:37:33.621679 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:37:33.622356 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:37:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:37:48.930636 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:37:48.931316 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:37:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:38:01.984334 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:38:01.984896 dv-cinder-786933-2-iscsi devstack@n-api.service[100512]: Tue Apr 20 19:38:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!